2024-04-25T10:27:02.018 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T10:27:02.019 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client} --verbose --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084 --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/orig.config.yaml 2024-04-25T10:27:02.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T10:27:02.146 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client} email: pdonnell@redhat.com first_in_suite: false job_id: '7673084' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSEtMXgo5NPXrCaP4vEPckIwoFUTIgDWaJP5ToNuivPVmfdgXROTxH+jPOVtvstHwUPFFtlW/4TCtNGk6nYM6c= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtmNHSHcD2jPBDyZLgqNEdOLjEBncgQqQwrzVc9NdKs7YQVkZ1qoftTpIYaM3B3gnNIe4b2sCNUPKmQIHDbP38= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - workunit: clients: client.0: - client/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T10:27:02.146 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T10:27:02.147 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T10:27:02.147 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T10:27:02.149 INFO:teuthology.task.internal:Checking packages... 2024-04-25T10:27:02.172 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T10:27:02.172 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T10:27:02.172 INFO:teuthology.packaging:ref: None 2024-04-25T10:27:02.172 INFO:teuthology.packaging:tag: None 2024-04-25T10:27:02.173 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:27:02.173 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:27:02.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:27:02.311 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T10:27:02.312 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T10:27:02.319 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T10:27:02.319 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T10:27:02.329 INFO:teuthology.task.internal:Saving configuration 2024-04-25T10:27:02.346 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T10:27:02.352 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T10:27:02.374 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 10:21:38.882244', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSEtMXgo5NPXrCaP4vEPckIwoFUTIgDWaJP5ToNuivPVmfdgXROTxH+jPOVtvstHwUPFFtlW/4TCtNGk6nYM6c='} 2024-04-25T10:27:02.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 10:21:38.884160', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtmNHSHcD2jPBDyZLgqNEdOLjEBncgQqQwrzVc9NdKs7YQVkZ1qoftTpIYaM3B3gnNIe4b2sCNUPKmQIHDbP38='} 2024-04-25T10:27:02.398 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T10:27:02.404 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T10:27:02.405 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T10:27:02.405 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T10:27:02.478 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff859993e50>, signals=[15]) 2024-04-25T10:27:02.479 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T10:27:02.485 INFO:teuthology.task.internal:Opening connections... 2024-04-25T10:27:02.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:27:02.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:27:02.564 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:27:02.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:27:02.641 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T10:27:02.648 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-04-25T10:27:02.666 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-04-25T10:27:02.666 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-04-25T10:27:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T10:27:02.724 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T10:27:02.725 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-04-25T10:27:02.747 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-25T10:27:02.767 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-25T10:27:02.767 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-25T10:27:02.824 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-04-25T10:27:02.824 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-04-25T10:27:02.824 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-04-25T10:27:02.824 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T10:27:02.825 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T10:27:02.826 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-25T10:27:02.845 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T10:27:02.854 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T10:27:02.859 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T10:27:02.860 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-04-25T10:27:02.862 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-04-25T10:27:02.881 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T10:27:02.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T10:27:02.888 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-04-25T10:27:02.920 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-04-25T10:27:03.019 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T10:27:03.078 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T10:27:03.137 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T10:27:03.137 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T10:27:03.138 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T10:27:03.138 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T10:27:03.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:27:03.156 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-04-25T10:27:03.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:27:03.157 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-04-25T10:27:03.217 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-437.el9.x86_64 2024-04-25T10:27:03.218 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.14.0-437.el9.x86_64 2024-04-25T10:27:03.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2024-04-25T10:27:03.220 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-437.el9.x86_64 2024-04-25T10:27:03.220 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-437.el9.x86_64 2024-04-25T10:27:03.220 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-04-25T10:27:05.486 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-25T10:27:05.998 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.0 MB 00:01 2024-04-25T10:27:07.612 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-25T10:27:08.383 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-25T10:27:11.738 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T10:27:12.700 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-25T10:27:13.172 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-04-25T10:27:14.215 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-04-25T10:27:15.184 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-04-25T10:27:16.689 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-25T10:27:19.190 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-04-25T10:27:21.096 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T10:27:21.096 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T10:27:21.186 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-25T10:27:21.186 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-25T10:27:21.187 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-25T10:27:21.288 DEBUG:teuthology.orchestra.run.smithi132:> echo no | sudo yum reinstall kernel || true 2024-04-25T10:27:21.711 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-04-25T10:27:21.790 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 10:27:19 AM UTC. 2024-04-25T10:27:21.909 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-25T10:27:21.921 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalling: 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 255 k 2024-04-25T10:27:21.922 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 0 2024-04-25T10:27:21.923 INFO:teuthology.orchestra.run.smithi132.stderr:Operation aborted. 2024-04-25T10:27:21.981 INFO:teuthology.orchestra.run.smithi132.stdout:Is this ok [y/N]: 2024-04-25T10:27:21.982 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum reinstall -y kernel || true 2024-04-25T10:27:22.477 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 10:27:19 AM UTC. 2024-04-25T10:27:22.595 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-25T10:27:22.596 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T10:27:22.596 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-04-25T10:27:22.596 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T10:27:22.596 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalling: 2024-04-25T10:27:22.596 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T10:27:22.596 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:27:22.597 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-25T10:27:22.597 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T10:27:22.597 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:27:22.597 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 255 k 2024-04-25T10:27:22.597 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 0 2024-04-25T10:27:22.597 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-25T10:27:22.842 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-25T10:27:22.842 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-25T10:27:22.842 INFO:teuthology.orchestra.run.smithi132.stdout:Total 1.0 MB/s | 255 kB 00:00 2024-04-25T10:27:22.859 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-25T10:27:23.028 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-25T10:27:23.028 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-25T10:27:23.033 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-25T10:27:23.033 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-25T10:27:23.156 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-25T10:27:23.234 INFO:teuthology.orchestra.run.smithi132.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T10:27:23.235 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T10:27:23.609 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T10:27:23.609 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T10:27:23.697 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-04-25T10:27:23.698 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-04-25T10:27:23.698 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-04-25T10:27:23.822 DEBUG:teuthology.orchestra.run.smithi103:> echo no | sudo yum reinstall kernel || true 2024-04-25T10:27:23.907 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T10:27:23.907 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T10:27:24.361 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 10:27:21 AM UTC. 2024-04-25T10:27:24.484 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-04-25T10:27:24.492 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-04-25T10:27:24.492 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-04-25T10:27:24.493 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-04-25T10:27:24.493 INFO:teuthology.orchestra.run.smithi103.stdout:Reinstalling: 2024-04-25T10:27:24.493 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T10:27:24.493 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:27:24.493 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-04-25T10:27:24.493 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-04-25T10:27:24.493 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:27:24.494 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 255 k 2024-04-25T10:27:24.494 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 0 2024-04-25T10:27:24.494 INFO:teuthology.orchestra.run.smithi103.stderr:Operation aborted. 2024-04-25T10:27:24.554 INFO:teuthology.orchestra.run.smithi103.stdout:Is this ok [y/N]: 2024-04-25T10:27:24.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum reinstall -y kernel || true 2024-04-25T10:27:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T10:27:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:27:24.559 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalled: 2024-04-25T10:27:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T10:27:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:27:24.559 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-25T10:27:24.729 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T10:27:24.775 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T10:27:24.776 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T10:27:24.776 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T10:27:24.776 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T10:27:24.776 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T10:27:24.807 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2024-04-25T10:27:24.827 DEBUG:teuthology.parallel:result is None 2024-04-25T10:27:25.045 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 10:27:21 AM UTC. 2024-04-25T10:27:25.160 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout:Reinstalling: 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-04-25T10:27:25.161 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:27:25.162 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 255 k 2024-04-25T10:27:25.162 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 0 2024-04-25T10:27:25.162 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-04-25T10:27:25.396 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-437.el9.x86_64.rpm 2.7 MB/s | 255 kB 00:00 2024-04-25T10:27:25.397 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-04-25T10:27:25.397 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.1 MB/s | 255 kB 00:00 2024-04-25T10:27:25.413 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-04-25T10:27:25.599 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-04-25T10:27:25.599 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-04-25T10:27:25.604 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-04-25T10:27:25.604 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-04-25T10:27:25.747 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-04-25T10:27:25.814 INFO:teuthology.orchestra.run.smithi103.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T10:27:25.814 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T10:27:26.508 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T10:27:26.508 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T10:27:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T10:27:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:27:27.225 INFO:teuthology.orchestra.run.smithi103.stdout:Reinstalled: 2024-04-25T10:27:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T10:27:27.225 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:27:27.225 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-04-25T10:27:27.409 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T10:27:27.455 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T10:27:27.456 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T10:27:27.456 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T10:27:27.456 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T10:27:27.456 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T10:27:27.482 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-04-25T10:27:27.506 DEBUG:teuthology.parallel:result is None 2024-04-25T10:27:27.507 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T10:27:27.514 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T10:27:27.514 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T10:27:27.549 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T10:27:27.567 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T10:27:27.574 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T10:27:27.582 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T10:27:27.582 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T10:27:27.604 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T10:27:27.710 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T10:27:27.718 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T10:27:27.719 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T10:27:27.721 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T10:27:27.755 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:27:27.756 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:27:27.765 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:27:27.766 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:27:27.768 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T10:27:27.774 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T10:27:27.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T10:27:27.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T10:27:27.837 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T10:27:27.845 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T10:27:27.845 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T10:27:27.873 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T10:27:27.894 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:27:27.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:27:28.016 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:27:28.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:27:28.136 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:27:28.137 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T10:27:28.200 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:27:28.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:27:28.297 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:27:28.380 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:27:28.426 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:27:28.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T10:27:28.494 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-04-25T10:27:28.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-04-25T10:27:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:27:28.576 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:27:29.048 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T10:27:29.057 INFO:teuthology.task.internal:Starting timer... 2024-04-25T10:27:29.057 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T10:27:29.068 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T10:27:29.077 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T10:27:29.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-04-25T10:27:29.127 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-04-25T10:27:29.129 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-04-25T10:27:29.175 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-04-25T10:27:29.177 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T10:27:29.177 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-04-25T10:27:29.195 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-04-25T10:27:29.195 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-04-25T10:27:29.235 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-04-25T10:27:29.235 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi132.front.sepia.ceph.com': 'permissive'} 2024-04-25T10:27:29.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T10:27:29.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:27:29.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T10:27:29.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:27:29.301 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T10:27:29.301 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-04-25T10:27:29.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-04-25T10:27:29.371 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T10:27:29.380 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T10:27:29.399 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T10:27:29.401 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T10:30:57.170 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2024-04-25T10:30:57.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-04-25T10:30:57.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:30:57.251 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-04-25T10:30:57.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-04-25T10:30:57.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-25T10:30:57.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:30:57.401 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-25T10:30:57.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-25T10:30:57.434 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T10:30:57.444 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T10:30:57.444 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T10:30:57.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:30:57.447 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T10:30:57.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:30:57.473 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T10:30:57.486 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T10:30:57.501 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T10:30:57.508 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-04-25T10:30:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T10:30:57.518 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-04-25T10:30:57.531 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T10:30:57.536 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-04-25T10:30:57.544 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T10:30:57.547 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-04-25T10:30:57.560 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T10:30:57.573 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T10:30:57.604 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:30:57.608 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:30:57.608 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-04-25T10:30:57.608 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:57.608 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:57.608 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:57.608 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:57.630 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:30:57.634 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:30:57.635 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-04-25T10:30:57.635 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:57.635 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:57.635 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:57.635 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:30:57.635 INFO:teuthology.run_tasks:Running task install... 2024-04-25T10:30:57.644 DEBUG:teuthology.task.install:project ceph 2024-04-25T10:30:57.644 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T10:30:57.644 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T10:30:57.644 INFO:teuthology.task.install:Using flavor: default 2024-04-25T10:30:57.650 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T10:30:57.650 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T10:30:57.650 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T10:30:57.651 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:30:57.652 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T10:30:57.653 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:30:57.799 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T10:30:57.799 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T10:30:57.893 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/ 2024-04-25T10:30:57.893 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3291.g994e2f20 2024-04-25T10:30:58.245 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T10:30:58.246 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:30:58.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T10:30:58.272 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T10:30:58.273 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T10:30:58.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T10:30:58.342 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T10:30:58.342 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:30:58.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T10:30:58.367 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T10:30:58.368 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/994e2f20102a20fa9a27966c14b625cc01884df8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T10:30:58.414 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T10:30:58.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T10:30:58.477 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-04-25T10:30:58.478 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-04-25T10:30:58.507 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T10:30:58.571 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-04-25T10:30:58.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-04-25T10:30:58.704 INFO:teuthology.orchestra.run.smithi103.stdout:48 files removed 2024-04-25T10:30:58.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T10:30:58.796 INFO:teuthology.orchestra.run.smithi132.stdout:48 files removed 2024-04-25T10:30:58.824 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T10:30:59.853 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 97 kB/s | 84 kB 00:00 2024-04-25T10:30:59.982 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 93 kB/s | 84 kB 00:00 2024-04-25T10:31:00.762 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 13 kB/s | 12 kB 00:00 2024-04-25T10:31:00.766 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 16 kB/s | 12 kB 00:00 2024-04-25T10:31:01.475 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-04-25T10:31:01.548 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 2.5 kB/s | 1.9 kB 00:00 2024-04-25T10:31:02.108 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-25T10:31:02.440 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.0 MB 00:00 2024-04-25T10:31:04.051 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T10:31:04.541 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-04-25T10:31:08.270 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.2 MB 00:00 2024-04-25T10:31:08.734 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-04-25T10:31:09.687 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-04-25T10:31:11.043 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-25T10:31:11.108 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-25T10:31:12.680 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-25T10:31:16.238 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T10:31:17.786 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-25T10:31:18.406 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T10:31:18.407 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T10:31:18.417 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T10:31:18.418 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T10:31:18.419 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T10:31:18.420 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T10:31:18.421 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T10:31:18.424 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T10:31:18.425 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T10:31:18.486 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-25T10:31:18.494 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T10:31:18.495 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T10:31:18.496 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T10:31:18.497 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T10:31:18.497 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T10:31:18.497 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T10:31:18.497 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T10:31:18.497 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T10:31:18.497 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T10:31:18.497 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T10:31:18.497 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-04-25T10:31:18.498 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T10:31:18.499 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T10:31:18.499 INFO:teuthology.orchestra.run.smithi132.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T10:31:18.499 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T10:31:18.499 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-25T10:31:18.499 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T10:31:18.499 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T10:31:18.499 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T10:31:18.499 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T10:31:18.500 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T10:31:18.501 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T10:31:18.502 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T10:31:18.503 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T10:31:18.504 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T10:31:18.505 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T10:31:18.506 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T10:31:18.507 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T10:31:18.508 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T10:31:18.509 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout:Install 148 Packages 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 4 Packages 2024-04-25T10:31:18.510 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:31:18.511 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 214 M 2024-04-25T10:31:18.511 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-25T10:31:19.423 INFO:teuthology.orchestra.run.smithi132.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-04-25T10:31:19.946 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T10:31:19.947 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T10:31:19.957 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T10:31:19.958 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T10:31:19.959 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T10:31:19.960 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T10:31:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T10:31:19.963 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T10:31:19.964 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T10:31:20.025 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 6.6 k 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.4 M 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 863 k 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 147 k 2024-04-25T10:31:20.034 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 1.5 M 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 142 k 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 3.5 M 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 7.4 M 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 49 k 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 10 M 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 43 M 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 273 k 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 762 k 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 224 k 2024-04-25T10:31:20.035 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 27 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 18 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 32 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 756 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 127 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T10:31:20.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 161 k 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 321 k 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 298 k 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 100 k 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 86 k 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.0 M 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 169 k 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.3 M 2024-04-25T10:31:20.037 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 3.1 M 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 20 M 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 34 k 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 2.3 M 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 249 k 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 4.9 M 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 18 M 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3291.g994e2f20.el9 ceph-noarch 16 k 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 25 k 2024-04-25T10:31:20.038 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 158 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 497 k 2024-04-25T10:31:20.039 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 5.2 M 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T10:31:20.040 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 45 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.0.0-3291.g994e2f20.el9 ceph 135 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T10:31:20.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T10:31:20.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T10:31:20.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T10:31:20.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:31:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-04-25T10:31:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-04-25T10:31:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:Install 148 Packages 2024-04-25T10:31:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 4 Packages 2024-04-25T10:31:20.046 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:31:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 214 M 2024-04-25T10:31:20.046 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-04-25T10:31:20.265 INFO:teuthology.orchestra.run.smithi132.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 1.0 MB/s | 863 kB 00:00 2024-04-25T10:31:20.382 INFO:teuthology.orchestra.run.smithi132.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 1.2 MB/s | 147 kB 00:00 2024-04-25T10:31:20.765 INFO:teuthology.orchestra.run.smithi132.stdout:(4/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-04-25T10:31:21.066 INFO:teuthology.orchestra.run.smithi132.stdout:(5/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 5.0 MB/s | 1.5 MB 00:00 2024-04-25T10:31:21.296 INFO:teuthology.orchestra.run.smithi103.stdout:(1/152): ceph-19.0.0-3291.g994e2f20.el9.x86_64. 11 kB/s | 6.6 kB 00:00 2024-04-25T10:31:21.441 INFO:teuthology.orchestra.run.smithi132.stdout:(6/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 2.1 MB/s | 2.3 MB 00:01 2024-04-25T10:31:22.149 INFO:teuthology.orchestra.run.smithi132.stdout:(7/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 4.5 MB/s | 4.9 MB 00:01 2024-04-25T10:31:22.263 INFO:teuthology.orchestra.run.smithi103.stdout:(2/152): ceph-fuse-19.0.0-3291.g994e2f20.el9.x8 893 kB/s | 863 kB 00:00 2024-04-25T10:31:22.438 INFO:teuthology.orchestra.run.smithi103.stdout:(3/152): ceph-immutable-object-cache-19.0.0-329 841 kB/s | 147 kB 00:00 2024-04-25T10:31:22.550 INFO:teuthology.orchestra.run.smithi132.stdout:(8/152): ceph-common-19.0.0-3291.g994e2f20.el9. 5.5 MB/s | 20 MB 00:03 2024-04-25T10:31:22.644 INFO:teuthology.orchestra.run.smithi132.stdout:(9/152): ceph-selinux-19.0.0-3291.g994e2f20.el9 270 kB/s | 25 kB 00:00 2024-04-25T10:31:24.122 INFO:teuthology.orchestra.run.smithi103.stdout:(4/152): ceph-mds-19.0.0-3291.g994e2f20.el9.x86 1.3 MB/s | 2.3 MB 00:01 2024-04-25T10:31:24.305 INFO:teuthology.orchestra.run.smithi103.stdout:(5/152): ceph-base-19.0.0-3291.g994e2f20.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-04-25T10:31:25.131 INFO:teuthology.orchestra.run.smithi103.stdout:(6/152): ceph-mgr-19.0.0-3291.g994e2f20.el9.x86 1.5 MB/s | 1.5 MB 00:01 2024-04-25T10:31:25.235 INFO:teuthology.orchestra.run.smithi132.stdout:(10/152): ceph-radosgw-19.0.0-3291.g994e2f20.el 3.3 MB/s | 10 MB 00:03 2024-04-25T10:31:25.427 INFO:teuthology.orchestra.run.smithi132.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 1.1 MB/s | 224 kB 00:00 2024-04-25T10:31:25.527 INFO:teuthology.orchestra.run.smithi132.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 271 kB/s | 27 kB 00:00 2024-04-25T10:31:25.619 INFO:teuthology.orchestra.run.smithi132.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 346 kB/s | 32 kB 00:00 2024-04-25T10:31:25.889 INFO:teuthology.orchestra.run.smithi103.stdout:(7/152): ceph-common-19.0.0-3291.g994e2f20.el9. 3.8 MB/s | 20 MB 00:05 2024-04-25T10:31:25.894 INFO:teuthology.orchestra.run.smithi132.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 2.7 MB/s | 756 kB 00:00 2024-04-25T10:31:26.020 INFO:teuthology.orchestra.run.smithi132.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 1.2 MB/s | 158 kB 00:00 2024-04-25T10:31:26.145 INFO:teuthology.orchestra.run.smithi132.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.0 MB/s | 127 kB 00:00 2024-04-25T10:31:26.412 INFO:teuthology.orchestra.run.smithi132.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 1.8 MB/s | 497 kB 00:00 2024-04-25T10:31:27.189 INFO:teuthology.orchestra.run.smithi103.stdout:(8/152): ceph-mon-19.0.0-3291.g994e2f20.el9.x86 1.7 MB/s | 4.9 MB 00:02 2024-04-25T10:31:27.298 INFO:teuthology.orchestra.run.smithi103.stdout:(9/152): ceph-radosgw-19.0.0-3291.g994e2f20.el9 7.2 MB/s | 10 MB 00:01 2024-04-25T10:31:27.340 INFO:teuthology.orchestra.run.smithi103.stdout:(10/152): ceph-selinux-19.0.0-3291.g994e2f20.el 168 kB/s | 25 kB 00:00 2024-04-25T10:31:27.523 INFO:teuthology.orchestra.run.smithi103.stdout:(11/152): cephfs-mirror-19.0.0-3291.g994e2f20.e 1.2 MB/s | 224 kB 00:00 2024-04-25T10:31:27.623 INFO:teuthology.orchestra.run.smithi103.stdout:(12/152): cephfs-shell-19.0.0-3291.g994e2f20.el 271 kB/s | 27 kB 00:00 2024-04-25T10:31:27.724 INFO:teuthology.orchestra.run.smithi103.stdout:(13/152): libcephfs-devel-19.0.0-3291.g994e2f20 317 kB/s | 32 kB 00:00 2024-04-25T10:31:28.141 INFO:teuthology.orchestra.run.smithi103.stdout:(14/152): libcephfs2-19.0.0-3291.g994e2f20.el9. 1.8 MB/s | 756 kB 00:00 2024-04-25T10:31:28.204 INFO:teuthology.orchestra.run.smithi132.stdout:(18/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 7.8 MB/s | 43 MB 00:05 2024-04-25T10:31:28.299 INFO:teuthology.orchestra.run.smithi103.stdout:(15/152): libcephsqlite-19.0.0-3291.g994e2f20.e 998 kB/s | 158 kB 00:00 2024-04-25T10:31:28.321 INFO:teuthology.orchestra.run.smithi132.stdout:(19/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 2.7 MB/s | 5.2 MB 00:01 2024-04-25T10:31:28.347 INFO:teuthology.orchestra.run.smithi132.stdout:(20/152): python3-ceph-argparse-19.0.0-3291.g99 318 kB/s | 45 kB 00:00 2024-04-25T10:31:28.375 INFO:teuthology.orchestra.run.smithi103.stdout:(16/152): librados-devel-19.0.0-3291.g994e2f20. 1.7 MB/s | 127 kB 00:00 2024-04-25T10:31:28.413 INFO:teuthology.orchestra.run.smithi132.stdout:(21/152): python3-ceph-common-19.0.0-3291.g994e 1.4 MB/s | 135 kB 00:00 2024-04-25T10:31:28.439 INFO:teuthology.orchestra.run.smithi132.stdout:(22/152): python3-cephfs-19.0.0-3291.g994e2f20. 1.7 MB/s | 161 kB 00:00 2024-04-25T10:31:28.531 INFO:teuthology.orchestra.run.smithi132.stdout:(23/152): python3-rbd-19.0.0-3291.g994e2f20.el9 3.2 MB/s | 298 kB 00:00 2024-04-25T10:31:28.556 INFO:teuthology.orchestra.run.smithi132.stdout:(24/152): python3-rados-19.0.0-3291.g994e2f20.e 2.2 MB/s | 321 kB 00:00 2024-04-25T10:31:28.606 INFO:teuthology.orchestra.run.smithi132.stdout:(25/152): python3-rgw-19.0.0-3291.g994e2f20.el9 1.3 MB/s | 100 kB 00:00 2024-04-25T10:31:28.616 INFO:teuthology.orchestra.run.smithi103.stdout:(17/152): libradosstriper1-19.0.0-3291.g994e2f2 2.0 MB/s | 497 kB 00:00 2024-04-25T10:31:28.632 INFO:teuthology.orchestra.run.smithi132.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.1 MB/s | 86 kB 00:00 2024-04-25T10:31:28.757 INFO:teuthology.orchestra.run.smithi132.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.3 MB/s | 169 kB 00:00 2024-04-25T10:31:28.840 INFO:teuthology.orchestra.run.smithi132.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 412 kB/s | 34 kB 00:00 2024-04-25T10:31:28.941 INFO:teuthology.orchestra.run.smithi132.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.4 MB/s | 142 kB 00:00 2024-04-25T10:31:29.091 INFO:teuthology.orchestra.run.smithi132.stdout:(30/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 6.3 MB/s | 3.0 MB 00:00 2024-04-25T10:31:30.166 INFO:teuthology.orchestra.run.smithi132.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 2.9 MB/s | 3.5 MB 00:01 2024-04-25T10:31:30.258 INFO:teuthology.orchestra.run.smithi132.stdout:(32/152): ceph-mgr-diskprediction-local-19.0.0- 6.3 MB/s | 7.4 MB 00:01 2024-04-25T10:31:30.325 INFO:teuthology.orchestra.run.smithi132.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3291.g99 1.5 MB/s | 249 kB 00:00 2024-04-25T10:31:30.342 INFO:teuthology.orchestra.run.smithi132.stdout:(34/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 591 kB/s | 49 kB 00:00 2024-04-25T10:31:30.384 INFO:teuthology.orchestra.run.smithi132.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3291.g9 280 kB/s | 16 kB 00:00 2024-04-25T10:31:30.418 INFO:teuthology.orchestra.run.smithi132.stdout:(36/152): ceph-volume-19.0.0-3291.g994e2f20.el9 3.5 MB/s | 273 kB 00:00 2024-04-25T10:31:30.493 INFO:teuthology.orchestra.run.smithi132.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 243 kB/s | 18 kB 00:00 2024-04-25T10:31:30.552 INFO:teuthology.orchestra.run.smithi132.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-04-25T10:31:30.627 INFO:teuthology.orchestra.run.smithi132.stdout:(39/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 3.1 MB/s | 762 kB 00:00 2024-04-25T10:31:30.661 INFO:teuthology.orchestra.run.smithi132.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-04-25T10:31:30.719 INFO:teuthology.orchestra.run.smithi132.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-25T10:31:30.753 INFO:teuthology.orchestra.run.smithi132.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-25T10:31:30.808 INFO:teuthology.orchestra.run.smithi103.stdout:(18/152): librgw2-19.0.0-3291.g994e2f20.el9.x86 2.4 MB/s | 5.2 MB 00:02 2024-04-25T10:31:30.820 INFO:teuthology.orchestra.run.smithi132.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-25T10:31:30.854 INFO:teuthology.orchestra.run.smithi132.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-04-25T10:31:30.867 INFO:teuthology.orchestra.run.smithi103.stdout:(19/152): python3-ceph-argparse-19.0.0-3291.g99 774 kB/s | 45 kB 00:00 2024-04-25T10:31:30.912 INFO:teuthology.orchestra.run.smithi132.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-25T10:31:30.934 INFO:teuthology.orchestra.run.smithi103.stdout:(20/152): python3-ceph-common-19.0.0-3291.g994e 2.0 MB/s | 135 kB 00:00 2024-04-25T10:31:30.937 INFO:teuthology.orchestra.run.smithi132.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-25T10:31:30.993 INFO:teuthology.orchestra.run.smithi103.stdout:(21/152): python3-cephfs-19.0.0-3291.g994e2f20. 2.7 MB/s | 161 kB 00:00 2024-04-25T10:31:31.004 INFO:teuthology.orchestra.run.smithi132.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-25T10:31:31.110 INFO:teuthology.orchestra.run.smithi103.stdout:(22/152): python3-rados-19.0.0-3291.g994e2f20.e 2.7 MB/s | 321 kB 00:00 2024-04-25T10:31:31.180 INFO:teuthology.orchestra.run.smithi132.stdout:(48/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 1.8 MB/s | 18 MB 00:09 2024-04-25T10:31:31.364 INFO:teuthology.orchestra.run.smithi132.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 584 kB/s | 107 kB 00:00 2024-04-25T10:31:31.397 INFO:teuthology.orchestra.run.smithi132.stdout:(50/152): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 689 kB 00:00 2024-04-25T10:31:31.422 INFO:teuthology.orchestra.run.smithi132.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 368 kB/s | 21 kB 00:00 2024-04-25T10:31:31.456 INFO:teuthology.orchestra.run.smithi132.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-04-25T10:31:31.481 INFO:teuthology.orchestra.run.smithi132.stdout:(53/152): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 943 kB 00:00 2024-04-25T10:31:31.506 INFO:teuthology.orchestra.run.smithi132.stdout:(54/152): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-04-25T10:31:31.527 INFO:teuthology.orchestra.run.smithi103.stdout:(23/152): ceph-test-19.0.0-3291.g994e2f20.el9.x 10 MB/s | 43 MB 00:04 2024-04-25T10:31:31.540 INFO:teuthology.orchestra.run.smithi132.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-04-25T10:31:31.553 INFO:teuthology.orchestra.run.smithi103.stdout:(24/152): python3-rbd-19.0.0-3291.g994e2f20.el9 674 kB/s | 298 kB 00:00 2024-04-25T10:31:31.557 INFO:teuthology.orchestra.run.smithi132.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-04-25T10:31:31.586 INFO:teuthology.orchestra.run.smithi103.stdout:(25/152): python3-rgw-19.0.0-3291.g994e2f20.el9 1.7 MB/s | 100 kB 00:00 2024-04-25T10:31:31.599 INFO:teuthology.orchestra.run.smithi132.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-25T10:31:31.611 INFO:teuthology.orchestra.run.smithi103.stdout:(26/152): rbd-fuse-19.0.0-3291.g994e2f20.el9.x8 1.4 MB/s | 86 kB 00:00 2024-04-25T10:31:31.616 INFO:teuthology.orchestra.run.smithi132.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-04-25T10:31:31.666 INFO:teuthology.orchestra.run.smithi132.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-04-25T10:31:31.700 INFO:teuthology.orchestra.run.smithi132.stdout:(60/152): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-04-25T10:31:31.717 INFO:teuthology.orchestra.run.smithi132.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 506 kB/s | 25 kB 00:00 2024-04-25T10:31:31.737 INFO:teuthology.orchestra.run.smithi103.stdout:(27/152): rbd-nbd-19.0.0-3291.g994e2f20.el9.x86 1.3 MB/s | 169 kB 00:00 2024-04-25T10:31:31.776 INFO:teuthology.orchestra.run.smithi132.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 3.6 MB/s | 582 kB 00:00 2024-04-25T10:31:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3291.g 682 kB/s | 34 kB 00:00 2024-04-25T10:31:31.792 INFO:teuthology.orchestra.run.smithi132.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 514 kB/s | 47 kB 00:00 2024-04-25T10:31:31.826 INFO:teuthology.orchestra.run.smithi132.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-25T10:31:31.843 INFO:teuthology.orchestra.run.smithi132.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 697 kB/s | 35 kB 00:00 2024-04-25T10:31:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:(29/152): rbd-mirror-19.0.0-3291.g994e2f20.el9. 12 MB/s | 3.0 MB 00:00 2024-04-25T10:31:31.868 INFO:teuthology.orchestra.run.smithi132.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-25T10:31:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3291.g994e2f2 1.7 MB/s | 142 kB 00:00 2024-04-25T10:31:32.019 INFO:teuthology.orchestra.run.smithi132.stdout:(67/152): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-25T10:31:32.077 INFO:teuthology.orchestra.run.smithi132.stdout:(68/152): openblas-openmp-0.3.21-2.el9.x86_64.r 19 MB/s | 4.7 MB 00:00 2024-04-25T10:31:32.121 INFO:teuthology.orchestra.run.smithi103.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3291.g994e2 13 MB/s | 3.5 MB 00:00 2024-04-25T10:31:32.161 INFO:teuthology.orchestra.run.smithi132.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-25T10:31:32.186 INFO:teuthology.orchestra.run.smithi132.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-04-25T10:31:32.188 INFO:teuthology.orchestra.run.smithi103.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3291.g99 3.6 MB/s | 249 kB 00:00 2024-04-25T10:31:32.220 INFO:teuthology.orchestra.run.smithi132.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 4.4 MB/s | 911 kB 00:00 2024-04-25T10:31:32.255 INFO:teuthology.orchestra.run.smithi103.stdout:(33/152): ceph-mgr-rook-19.0.0-3291.g994e2f20.e 740 kB/s | 49 kB 00:00 2024-04-25T10:31:32.262 INFO:teuthology.orchestra.run.smithi132.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-04-25T10:31:32.287 INFO:teuthology.orchestra.run.smithi132.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-25T10:31:32.313 INFO:teuthology.orchestra.run.smithi103.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3291.g9 283 kB/s | 16 kB 00:00 2024-04-25T10:31:32.354 INFO:teuthology.orchestra.run.smithi132.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-04-25T10:31:32.381 INFO:teuthology.orchestra.run.smithi103.stdout:(35/152): ceph-volume-19.0.0-3291.g994e2f20.el9 4.0 MB/s | 273 kB 00:00 2024-04-25T10:31:32.429 INFO:teuthology.orchestra.run.smithi132.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-04-25T10:31:32.454 INFO:teuthology.orchestra.run.smithi132.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-25T10:31:32.481 INFO:teuthology.orchestra.run.smithi103.stdout:(36/152): cephadm-19.0.0-3291.g994e2f20.el9.noa 7.4 MB/s | 762 kB 00:00 2024-04-25T10:31:32.488 INFO:teuthology.orchestra.run.smithi132.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-04-25T10:31:32.513 INFO:teuthology.orchestra.run.smithi132.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-04-25T10:31:32.548 INFO:teuthology.orchestra.run.smithi103.stdout:(37/152): cephfs-top-19.0.0-3291.g994e2f20.el9. 274 kB/s | 18 kB 00:00 2024-04-25T10:31:32.589 INFO:teuthology.orchestra.run.smithi132.stdout:(79/152): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-04-25T10:31:32.614 INFO:teuthology.orchestra.run.smithi132.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-04-25T10:31:32.639 INFO:teuthology.orchestra.run.smithi132.stdout:(81/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-04-25T10:31:32.673 INFO:teuthology.orchestra.run.smithi132.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-25T10:31:32.698 INFO:teuthology.orchestra.run.smithi132.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-25T10:31:32.732 INFO:teuthology.orchestra.run.smithi132.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-25T10:31:32.757 INFO:teuthology.orchestra.run.smithi132.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-04-25T10:31:32.823 INFO:teuthology.orchestra.run.smithi103.stdout:(38/152): ceph-osd-19.0.0-3291.g994e2f20.el9.x8 2.3 MB/s | 18 MB 00:07 2024-04-25T10:31:32.832 INFO:teuthology.orchestra.run.smithi132.stdout:(86/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-04-25T10:31:32.848 INFO:teuthology.orchestra.run.smithi103.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 268 kB/s | 80 kB 00:00 2024-04-25T10:31:32.858 INFO:teuthology.orchestra.run.smithi132.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-04-25T10:31:32.883 INFO:teuthology.orchestra.run.smithi132.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-04-25T10:31:32.908 INFO:teuthology.orchestra.run.smithi132.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-25T10:31:32.933 INFO:teuthology.orchestra.run.smithi132.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-04-25T10:31:32.940 INFO:teuthology.orchestra.run.smithi103.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-25T10:31:32.959 INFO:teuthology.orchestra.run.smithi132.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-04-25T10:31:32.992 INFO:teuthology.orchestra.run.smithi132.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 709 kB/s | 42 kB 00:00 2024-04-25T10:31:33.018 INFO:teuthology.orchestra.run.smithi132.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 751 kB/s | 44 kB 00:00 2024-04-25T10:31:33.049 INFO:teuthology.orchestra.run.smithi103.stdout:(41/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2024-04-25T10:31:33.051 INFO:teuthology.orchestra.run.smithi132.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-25T10:31:33.068 INFO:teuthology.orchestra.run.smithi132.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-04-25T10:31:33.074 INFO:teuthology.orchestra.run.smithi103.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-04-25T10:31:33.110 INFO:teuthology.orchestra.run.smithi132.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-04-25T10:31:33.166 INFO:teuthology.orchestra.run.smithi103.stdout:(43/152): ceph-mgr-diskprediction-local-19.0.0- 5.7 MB/s | 7.4 MB 00:01 2024-04-25T10:31:33.169 INFO:teuthology.orchestra.run.smithi132.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-25T10:31:33.191 INFO:teuthology.orchestra.run.smithi103.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 910 kB/s | 106 kB 00:00 2024-04-25T10:31:33.194 INFO:teuthology.orchestra.run.smithi132.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 690 kB/s | 58 kB 00:00 2024-04-25T10:31:33.225 INFO:teuthology.orchestra.run.smithi103.stdout:(45/152): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-04-25T10:31:33.228 INFO:teuthology.orchestra.run.smithi132.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T10:31:33.245 INFO:teuthology.orchestra.run.smithi132.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T10:31:33.267 INFO:teuthology.orchestra.run.smithi103.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-25T10:31:33.278 INFO:teuthology.orchestra.run.smithi132.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-04-25T10:31:33.292 INFO:teuthology.orchestra.run.smithi103.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-25T10:31:33.295 INFO:teuthology.orchestra.run.smithi132.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 443 kB/s | 22 kB 00:00 2024-04-25T10:31:33.309 INFO:teuthology.orchestra.run.smithi103.stdout:(48/152): python3-pycparser-2.20-6.el9.noarch.r 947 kB/s | 135 kB 00:00 2024-04-25T10:31:33.351 INFO:teuthology.orchestra.run.smithi103.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-04-25T10:31:33.377 INFO:teuthology.orchestra.run.smithi103.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-25T10:31:33.402 INFO:teuthology.orchestra.run.smithi103.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 427 kB/s | 21 kB 00:00 2024-04-25T10:31:33.454 INFO:teuthology.orchestra.run.smithi132.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-04-25T10:31:33.461 INFO:teuthology.orchestra.run.smithi103.stdout:(52/152): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-04-25T10:31:33.486 INFO:teuthology.orchestra.run.smithi103.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-04-25T10:31:33.496 INFO:teuthology.orchestra.run.smithi132.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-04-25T10:31:33.511 INFO:teuthology.orchestra.run.smithi103.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-04-25T10:31:33.537 INFO:teuthology.orchestra.run.smithi103.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-04-25T10:31:33.562 INFO:teuthology.orchestra.run.smithi103.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-04-25T10:31:33.587 INFO:teuthology.orchestra.run.smithi103.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T10:31:33.612 INFO:teuthology.orchestra.run.smithi103.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-04-25T10:31:33.646 INFO:teuthology.orchestra.run.smithi103.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-25T10:31:33.688 INFO:teuthology.orchestra.run.smithi103.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 611 kB/s | 25 kB 00:00 2024-04-25T10:31:33.730 INFO:teuthology.orchestra.run.smithi103.stdout:(61/152): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-04-25T10:31:33.746 INFO:teuthology.orchestra.run.smithi132.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-04-25T10:31:33.747 INFO:teuthology.orchestra.run.smithi103.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-04-25T10:31:33.797 INFO:teuthology.orchestra.run.smithi103.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T10:31:33.822 INFO:teuthology.orchestra.run.smithi103.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-25T10:31:33.847 INFO:teuthology.orchestra.run.smithi103.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-04-25T10:31:33.896 INFO:teuthology.orchestra.run.smithi132.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 699 kB/s | 309 kB 00:00 2024-04-25T10:31:33.898 INFO:teuthology.orchestra.run.smithi103.stdout:(66/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.8 MB/s | 3.0 MB 00:00 2024-04-25T10:31:33.922 INFO:teuthology.orchestra.run.smithi132.stdout:(107/152): abseil-cpp-20211102.0-3.el9.x86_64.r 875 kB/s | 548 kB 00:00 2024-04-25T10:31:33.964 INFO:teuthology.orchestra.run.smithi132.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 387 kB/s | 26 kB 00:00 2024-04-25T10:31:33.997 INFO:teuthology.orchestra.run.smithi132.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-04-25T10:31:34.048 INFO:teuthology.orchestra.run.smithi132.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 805 kB/s | 67 kB 00:00 2024-04-25T10:31:34.065 INFO:teuthology.orchestra.run.smithi103.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-04-25T10:31:34.082 INFO:teuthology.orchestra.run.smithi132.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-25T10:31:34.124 INFO:teuthology.orchestra.run.smithi103.stdout:(68/152): postgresql-contrib-13.14-1.el9.x86_64 15 MB/s | 911 kB 00:00 2024-04-25T10:31:34.166 INFO:teuthology.orchestra.run.smithi103.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-04-25T10:31:34.191 INFO:teuthology.orchestra.run.smithi103.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-25T10:31:34.223 INFO:teuthology.orchestra.run.smithi132.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-04-25T10:31:34.249 INFO:teuthology.orchestra.run.smithi132.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-04-25T10:31:34.258 INFO:teuthology.orchestra.run.smithi103.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-04-25T10:31:34.274 INFO:teuthology.orchestra.run.smithi132.stdout:(114/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-04-25T10:31:34.299 INFO:teuthology.orchestra.run.smithi132.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 575 kB/s | 43 kB 00:00 2024-04-25T10:31:34.300 INFO:teuthology.orchestra.run.smithi103.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-04-25T10:31:34.324 INFO:teuthology.orchestra.run.smithi132.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2024-04-25T10:31:34.350 INFO:teuthology.orchestra.run.smithi132.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-25T10:31:34.375 INFO:teuthology.orchestra.run.smithi132.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-25T10:31:34.417 INFO:teuthology.orchestra.run.smithi132.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-25T10:31:34.442 INFO:teuthology.orchestra.run.smithi132.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-25T10:31:34.468 INFO:teuthology.orchestra.run.smithi132.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 381 kB/s | 35 kB 00:00 2024-04-25T10:31:34.502 INFO:teuthology.orchestra.run.smithi132.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-25T10:31:34.542 INFO:teuthology.orchestra.run.smithi103.stdout:(73/152): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-04-25T10:31:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-04-25T10:31:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-25T10:31:34.625 INFO:teuthology.orchestra.run.smithi103.stdout:(74/152): openblas-openmp-0.3.21-2.el9.x86_64.r 5.9 MB/s | 4.7 MB 00:00 2024-04-25T10:31:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-25T10:31:34.651 INFO:teuthology.orchestra.run.smithi103.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-04-25T10:31:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-04-25T10:31:34.676 INFO:teuthology.orchestra.run.smithi103.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-04-25T10:31:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-04-25T10:31:34.701 INFO:teuthology.orchestra.run.smithi103.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-04-25T10:31:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-25T10:31:34.727 INFO:teuthology.orchestra.run.smithi103.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 379 kB/s | 19 kB 00:00 2024-04-25T10:31:34.752 INFO:teuthology.orchestra.run.smithi103.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-25T10:31:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-04-25T10:31:34.777 INFO:teuthology.orchestra.run.smithi103.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-04-25T10:31:34.778 INFO:teuthology.orchestra.run.smithi132.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2024-04-25T10:31:34.812 INFO:teuthology.orchestra.run.smithi132.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-04-25T10:31:34.838 INFO:teuthology.orchestra.run.smithi132.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 942 kB/s | 79 kB 00:00 2024-04-25T10:31:34.861 INFO:teuthology.orchestra.run.smithi103.stdout:(81/152): postgresql-server-13.14-1.el9.x86_64. 8.3 MB/s | 5.8 MB 00:00 2024-04-25T10:31:34.863 INFO:teuthology.orchestra.run.smithi132.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-04-25T10:31:34.886 INFO:teuthology.orchestra.run.smithi103.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-04-25T10:31:34.888 INFO:teuthology.orchestra.run.smithi132.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T10:31:34.913 INFO:teuthology.orchestra.run.smithi132.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-25T10:31:34.939 INFO:teuthology.orchestra.run.smithi132.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-25T10:31:34.962 INFO:teuthology.orchestra.run.smithi103.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-04-25T10:31:34.964 INFO:teuthology.orchestra.run.smithi132.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-25T10:31:34.979 INFO:teuthology.orchestra.run.smithi103.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 838 kB/s | 77 kB 00:00 2024-04-25T10:31:34.989 INFO:teuthology.orchestra.run.smithi132.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-25T10:31:35.004 INFO:teuthology.orchestra.run.smithi103.stdout:(85/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-04-25T10:31:35.014 INFO:teuthology.orchestra.run.smithi132.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T10:31:35.029 INFO:teuthology.orchestra.run.smithi103.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-04-25T10:31:35.040 INFO:teuthology.orchestra.run.smithi132.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-04-25T10:31:35.054 INFO:teuthology.orchestra.run.smithi103.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-25T10:31:35.065 INFO:teuthology.orchestra.run.smithi132.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-04-25T10:31:35.080 INFO:teuthology.orchestra.run.smithi103.stdout:(88/152): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-04-25T10:31:35.090 INFO:teuthology.orchestra.run.smithi132.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-04-25T10:31:35.105 INFO:teuthology.orchestra.run.smithi103.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T10:31:35.116 INFO:teuthology.orchestra.run.smithi132.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-25T10:31:35.130 INFO:teuthology.orchestra.run.smithi103.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-25T10:31:35.141 INFO:teuthology.orchestra.run.smithi132.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-25T10:31:35.155 INFO:teuthology.orchestra.run.smithi103.stdout:(91/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-04-25T10:31:35.174 INFO:teuthology.orchestra.run.smithi132.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-25T10:31:35.181 INFO:teuthology.orchestra.run.smithi103.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-04-25T10:31:35.200 INFO:teuthology.orchestra.run.smithi132.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-04-25T10:31:35.206 INFO:teuthology.orchestra.run.smithi103.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-04-25T10:31:35.225 INFO:teuthology.orchestra.run.smithi132.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-25T10:31:35.231 INFO:teuthology.orchestra.run.smithi103.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-25T10:31:35.248 INFO:teuthology.orchestra.run.smithi103.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 855 kB/s | 36 kB 00:00 2024-04-25T10:31:35.273 INFO:teuthology.orchestra.run.smithi103.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-25T10:31:35.283 INFO:teuthology.orchestra.run.smithi132.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-25T10:31:35.299 INFO:teuthology.orchestra.run.smithi103.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-25T10:31:35.316 INFO:teuthology.orchestra.run.smithi103.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-04-25T10:31:35.350 INFO:teuthology.orchestra.run.smithi103.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-25T10:31:35.370 INFO:teuthology.orchestra.run.smithi103.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-25T10:31:35.392 INFO:teuthology.orchestra.run.smithi103.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-04-25T10:31:35.409 INFO:teuthology.orchestra.run.smithi132.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 11 MB/s | 1.3 MB 00:00 2024-04-25T10:31:35.434 INFO:teuthology.orchestra.run.smithi103.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 333 kB/s | 22 kB 00:00 2024-04-25T10:31:35.559 INFO:teuthology.orchestra.run.smithi132.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-04-25T10:31:35.634 INFO:teuthology.orchestra.run.smithi103.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-04-25T10:31:35.710 INFO:teuthology.orchestra.run.smithi132.stdout:(151/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 6.4 MB/s | 3.1 MB 00:00 2024-04-25T10:31:36.034 INFO:teuthology.orchestra.run.smithi103.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 913 kB/s | 548 kB 00:00 2024-04-25T10:31:36.143 INFO:teuthology.orchestra.run.smithi103.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 607 kB/s | 309 kB 00:00 2024-04-25T10:31:36.151 INFO:teuthology.orchestra.run.smithi132.stdout:(152/152): librados2-19.0.0-3291.g994e2f20.el9. 3.5 MB/s | 3.3 MB 00:00 2024-04-25T10:31:36.157 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-25T10:31:36.158 INFO:teuthology.orchestra.run.smithi132.stdout:Total 12 MB/s | 214 MB 00:17 2024-04-25T10:31:36.352 INFO:teuthology.orchestra.run.smithi103.stdout:(106/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-04-25T10:31:36.377 INFO:teuthology.orchestra.run.smithi103.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 57 kB/s | 19 kB 00:00 2024-04-25T10:31:36.627 INFO:teuthology.orchestra.run.smithi103.stdout:(108/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 94 kB/s | 26 kB 00:00 2024-04-25T10:31:36.728 INFO:teuthology.orchestra.run.smithi103.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-25T10:31:36.995 INFO:teuthology.orchestra.run.smithi103.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 184 kB/s | 67 kB 00:00 2024-04-25T10:31:37.228 INFO:teuthology.orchestra.run.smithi103.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 302 kB/s | 151 kB 00:00 2024-04-25T10:31:37.271 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-25T10:31:37.415 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-25T10:31:37.415 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-25T10:31:37.420 INFO:teuthology.orchestra.run.smithi103.stdout:(112/152): libarrow-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-04-25T10:31:37.662 INFO:teuthology.orchestra.run.smithi103.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-25T10:31:37.762 INFO:teuthology.orchestra.run.smithi103.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-04-25T10:31:37.821 INFO:teuthology.orchestra.run.smithi103.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 925 kB/s | 548 kB 00:00 2024-04-25T10:31:37.955 INFO:teuthology.orchestra.run.smithi103.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 110 kB/s | 32 kB 00:00 2024-04-25T10:31:38.030 INFO:teuthology.orchestra.run.smithi103.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-25T10:31:38.247 INFO:teuthology.orchestra.run.smithi103.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 404 kB/s | 172 kB 00:00 2024-04-25T10:31:38.464 INFO:teuthology.orchestra.run.smithi103.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 704 kB/s | 358 kB 00:00 2024-04-25T10:31:38.506 INFO:teuthology.orchestra.run.smithi103.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 137 kB/s | 35 kB 00:00 2024-04-25T10:31:38.531 INFO:teuthology.orchestra.run.smithi103.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 605 kB/s | 303 kB 00:00 2024-04-25T10:31:38.956 INFO:teuthology.orchestra.run.smithi103.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 340 kB/s | 144 kB 00:00 2024-04-25T10:31:38.981 INFO:teuthology.orchestra.run.smithi103.stdout:(123/152): python3-google-auth-2.29.0-1.el9.noa 397 kB/s | 206 kB 00:00 2024-04-25T10:31:39.136 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-25T10:31:39.137 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-25T10:31:39.274 INFO:teuthology.orchestra.run.smithi103.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 34 kB/s | 11 kB 00:00 2024-04-25T10:31:39.299 INFO:teuthology.orchestra.run.smithi103.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 56 kB/s | 18 kB 00:00 2024-04-25T10:31:39.391 INFO:teuthology.orchestra.run.smithi103.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.3 MB/s | 2.0 MB 00:00 2024-04-25T10:31:39.583 INFO:teuthology.orchestra.run.smithi103.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 68 kB/s | 19 kB 00:00 2024-04-25T10:31:39.608 INFO:teuthology.orchestra.run.smithi103.stdout:(128/152): python3-jaraco-collections-3.0.0-8.e 69 kB/s | 23 kB 00:00 2024-04-25T10:31:39.658 INFO:teuthology.orchestra.run.smithi103.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-25T10:31:39.950 INFO:teuthology.orchestra.run.smithi103.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 135 kB/s | 46 kB 00:00 2024-04-25T10:31:40.000 INFO:teuthology.orchestra.run.smithi103.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 230 kB/s | 79 kB 00:00 2024-04-25T10:31:40.259 INFO:teuthology.orchestra.run.smithi103.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-25T10:31:40.293 INFO:teuthology.orchestra.run.smithi103.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 168 kB/s | 58 kB 00:00 2024-04-25T10:31:40.510 INFO:teuthology.orchestra.run.smithi103.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 535 kB/s | 272 kB 00:00 2024-04-25T10:31:40.535 INFO:teuthology.orchestra.run.smithi103.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 59 kB/s | 16 kB 00:00 2024-04-25T10:31:40.711 INFO:teuthology.orchestra.run.smithi103.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 215 kB/s | 90 kB 00:00 2024-04-25T10:31:40.769 INFO:teuthology.orchestra.run.smithi103.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 109 kB/s | 28 kB 00:00 2024-04-25T10:31:40.794 INFO:teuthology.orchestra.run.smithi103.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 119 kB/s | 31 kB 00:00 2024-04-25T10:31:41.053 INFO:teuthology.orchestra.run.smithi103.stdout:(139/152): python3-tempora-5.0.0-2.el9.noarch.r 138 kB/s | 36 kB 00:00 2024-04-25T10:31:41.103 INFO:teuthology.orchestra.run.smithi103.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 177 kB/s | 59 kB 00:00 2024-04-25T10:31:41.162 INFO:teuthology.orchestra.run.smithi103.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 418 kB/s | 188 kB 00:00 2024-04-25T10:31:41.395 INFO:teuthology.orchestra.run.smithi103.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-25T10:31:41.512 INFO:teuthology.orchestra.run.smithi103.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 256 kB/s | 90 kB 00:00 2024-04-25T10:31:41.621 INFO:teuthology.orchestra.run.smithi103.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 444 kB/s | 230 kB 00:00 2024-04-25T10:31:41.821 INFO:teuthology.orchestra.run.smithi103.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 65 kB/s | 20 kB 00:00 2024-04-25T10:31:42.013 INFO:teuthology.orchestra.run.smithi103.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 692 kB/s | 427 kB 00:00 2024-04-25T10:31:42.055 INFO:teuthology.orchestra.run.smithi103.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 442 kB/s | 192 kB 00:00 2024-04-25T10:31:42.497 INFO:teuthology.orchestra.run.smithi103.stdout:(148/152): librbd1-19.0.0-3291.g994e2f20.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-04-25T10:31:42.622 INFO:teuthology.orchestra.run.smithi103.stdout:(149/152): thrift-0.15.0-2.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-04-25T10:31:42.906 INFO:teuthology.orchestra.run.smithi103.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 3.3 MB/s | 1.3 MB 00:00 2024-04-25T10:31:42.956 INFO:teuthology.orchestra.run.smithi103.stdout:(151/152): librados2-19.0.0-3291.g994e2f20.el9. 3.5 MB/s | 3.3 MB 00:00 2024-04-25T10:31:43.473 INFO:teuthology.orchestra.run.smithi103.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.8 MB/s | 2.4 MB 00:00 2024-04-25T10:31:43.475 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-04-25T10:31:43.476 INFO:teuthology.orchestra.run.smithi103.stdout:Total 9.1 MB/s | 214 MB 00:23 2024-04-25T10:31:44.573 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-04-25T10:31:44.714 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-04-25T10:31:44.714 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-04-25T10:31:45.050 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-25T10:31:45.130 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T10:31:45.169 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T10:31:45.222 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T10:31:45.264 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T10:31:45.290 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T10:31:45.332 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T10:31:45.730 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T10:31:45.791 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:31:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:31:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:31:46.050 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:31:46.080 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T10:31:46.226 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T10:31:46.277 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T10:31:46.305 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:31:46.410 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:31:46.439 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T10:31:46.446 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-04-25T10:31:46.446 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-04-25T10:31:46.502 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T10:31:46.524 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T10:31:46.543 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T10:31:46.741 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T10:31:46.778 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T10:31:46.923 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T10:31:47.020 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T10:31:47.056 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T10:31:47.092 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T10:31:47.166 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T10:31:47.207 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T10:31:47.251 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T10:31:47.283 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T10:31:47.311 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T10:31:47.381 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T10:31:47.433 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T10:31:47.464 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T10:31:47.508 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T10:31:47.584 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T10:31:47.618 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T10:31:47.653 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T10:31:47.682 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T10:31:47.751 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T10:31:47.797 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T10:31:47.871 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T10:31:48.012 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T10:31:48.065 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T10:31:48.599 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T10:31:48.677 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T10:31:48.707 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T10:31:48.750 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T10:31:48.788 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T10:31:48.830 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T10:31:48.988 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T10:31:49.049 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T10:31:49.104 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T10:31:49.176 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T10:31:49.208 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T10:31:49.236 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T10:31:49.283 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T10:31:49.319 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T10:31:49.362 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T10:31:49.404 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T10:31:49.539 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T10:31:49.585 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T10:31:49.615 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T10:31:49.656 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T10:31:49.743 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T10:31:49.774 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T10:31:49.814 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T10:31:49.839 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T10:31:49.864 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T10:31:49.938 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T10:31:50.056 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T10:31:50.088 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T10:31:50.116 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T10:31:50.150 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T10:31:50.189 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T10:31:50.221 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T10:31:50.251 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T10:31:50.285 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T10:31:50.319 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T10:31:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T10:31:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T10:31:50.480 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T10:31:50.533 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T10:31:50.665 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T10:31:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T10:31:50.810 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T10:31:50.858 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T10:31:51.572 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T10:31:51.614 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T10:31:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T10:31:51.746 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T10:31:51.798 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T10:31:51.885 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T10:31:51.933 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T10:31:52.111 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T10:31:52.140 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T10:31:52.217 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T10:31:52.343 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-04-25T10:31:52.464 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T10:31:52.709 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T10:31:52.780 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T10:31:52.829 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T10:31:52.854 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T10:31:52.855 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T10:31:52.898 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T10:31:52.970 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T10:31:53.233 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T10:31:53.346 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:31:53.473 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:31:53.497 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:31:53.572 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:31:53.610 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T10:31:53.762 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T10:31:53.824 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T10:31:53.852 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:31:53.956 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:31:53.986 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T10:31:54.049 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 14/156 2024-04-25T10:31:54.070 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T10:31:54.090 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T10:31:54.194 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T10:31:54.271 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T10:31:54.286 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T10:31:54.303 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T10:31:54.314 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T10:31:54.347 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T10:31:54.414 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T10:31:54.515 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T10:31:54.553 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T10:31:54.588 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T10:31:54.652 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T10:31:54.666 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T10:31:54.695 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T10:31:54.738 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T10:31:54.743 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T10:31:54.771 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T10:31:54.799 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T10:31:54.834 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T10:31:54.865 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T10:31:54.868 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T10:31:54.901 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T10:31:54.921 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T10:31:54.952 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T10:31:54.987 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T10:31:55.072 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T10:31:55.106 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 31/156 2024-04-25T10:31:55.150 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 32/156 2024-04-25T10:31:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 33/156 2024-04-25T10:31:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T10:31:55.293 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T10:31:55.376 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T10:31:55.391 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T10:31:55.438 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T10:31:55.509 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T10:31:55.512 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T10:31:55.532 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T10:31:55.563 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T10:31:56.113 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T10:31:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T10:31:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T10:31:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T10:31:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 43/156 2024-04-25T10:31:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T10:31:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T10:31:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T10:31:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T10:31:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T10:31:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T10:31:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T10:31:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T10:31:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T10:31:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T10:31:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T10:31:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T10:31:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T10:31:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T10:31:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T10:31:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T10:31:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T10:31:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T10:31:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T10:31:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T10:31:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T10:31:57.664 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T10:31:57.694 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T10:31:57.722 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T10:31:57.732 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:31:57.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T10:31:57.761 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:31:57.796 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T10:31:57.828 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T10:31:57.858 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T10:31:57.894 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T10:31:57.925 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T10:31:57.967 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T10:31:58.002 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T10:31:58.088 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T10:31:58.132 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T10:31:58.163 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T10:31:58.210 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T10:31:58.317 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T10:31:58.327 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:31:58.364 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T10:31:58.373 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T10:31:58.447 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T10:31:58.447 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T10:31:58.447 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T10:31:58.447 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:31:58.474 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T10:31:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T10:31:59.137 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T10:31:59.171 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T10:31:59.273 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T10:31:59.329 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T10:31:59.417 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T10:31:59.473 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T10:31:59.651 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T10:31:59.679 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T10:31:59.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T10:32:00.404 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T10:32:00.519 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T10:32:01.760 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T10:32:01.860 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T10:32:01.887 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T10:32:01.920 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T10:32:02.242 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T10:32:02.283 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T10:32:02.374 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 99/156 2024-04-25T10:32:02.405 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 100/156 2024-04-25T10:32:02.441 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T10:32:02.931 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T10:32:03.062 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T10:32:03.133 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 103/156 2024-04-25T10:32:03.155 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 104/156 2024-04-25T10:32:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:32:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:32:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 105/156 2024-04-25T10:32:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T10:32:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 106/156 2024-04-25T10:32:06.047 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T10:32:06.047 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T10:32:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T10:32:10.030 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T10:32:10.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-04-25T10:32:10.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-04-25T10:32:10.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-04-25T10:32:10.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-04-25T10:32:10.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-04-25T10:32:10.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2024-04-25T10:32:10.031 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-04-25T10:32:10.031 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:10.206 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T10:32:10.222 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T10:32:10.222 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:10.222 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T10:32:10.222 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:11.817 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T10:32:11.843 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T10:32:11.843 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:11.843 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T10:32:11.843 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T10:32:11.843 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T10:32:11.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:12.068 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T10:32:12.091 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T10:32:12.091 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:12.091 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T10:32:12.091 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T10:32:12.091 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T10:32:12.091 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:12.552 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T10:32:12.575 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T10:32:12.575 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:12.575 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T10:32:12.575 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T10:32:12.575 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T10:32:12.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:12.674 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T10:32:12.722 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T10:32:12.777 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T10:32:12.961 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T10:32:13.011 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T10:32:13.088 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T10:32:13.177 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T10:32:13.309 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T10:32:13.345 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T10:32:13.368 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T10:32:13.397 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T10:32:13.832 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T10:32:13.862 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T10:32:13.894 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T10:32:13.956 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T10:32:13.994 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T10:32:15.031 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T10:32:15.070 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T10:32:16.034 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T10:32:16.062 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T10:32:16.163 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T10:32:16.330 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T10:32:16.356 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T10:32:16.379 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T10:32:16.379 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:16.379 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T10:32:16.379 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T10:32:16.379 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T10:32:16.380 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:16.423 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T10:32:16.435 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T10:32:16.534 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T10:32:16.588 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T10:32:17.522 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T10:32:17.560 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T10:32:17.583 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T10:32:17.583 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:17.583 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T10:32:17.583 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:32:17.583 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:32:17.583 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:17.627 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T10:32:17.649 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T10:32:17.649 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:17.649 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T10:32:17.649 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:17.694 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T10:32:17.717 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T10:32:17.862 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:17.862 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T10:32:17.862 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:32:17.862 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:32:17.862 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:17.863 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 107/156 2024-04-25T10:32:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-04-25T10:32:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-04-25T10:32:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-04-25T10:32:17.863 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-04-25T10:32:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-04-25T10:32:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-04-25T10:32:17.864 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-04-25T10:32:17.864 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:17.975 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T10:32:17.987 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 108/156 2024-04-25T10:32:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:17.988 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T10:32:17.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:18.045 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T10:32:18.634 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T10:32:18.635 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:18.635 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T10:32:18.635 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T10:32:18.635 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T10:32:18.635 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T10:32:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 109/156 2024-04-25T10:32:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T10:32:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T10:32:19.600 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T10:32:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:19.833 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T10:32:19.856 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 110/156 2024-04-25T10:32:19.856 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T10:32:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T10:32:19.857 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T10:32:19.857 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:20.326 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T10:32:20.348 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 111/156 2024-04-25T10:32:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:20.348 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T10:32:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T10:32:20.349 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T10:32:20.349 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:20.465 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T10:32:20.522 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T10:32:20.577 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T10:32:20.764 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T10:32:20.819 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T10:32:20.888 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T10:32:20.977 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T10:32:21.117 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T10:32:21.152 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T10:32:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T10:32:21.220 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T10:32:21.581 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T10:32:21.610 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 123/156 2024-04-25T10:32:21.643 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 124/156 2024-04-25T10:32:21.704 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 125/156 2024-04-25T10:32:21.734 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T10:32:22.340 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T10:32:22.382 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T10:32:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T10:32:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T10:32:22.482 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T10:32:22.664 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T10:32:22.712 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T10:32:22.741 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T10:32:22.780 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 126/156 2024-04-25T10:32:22.827 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T10:32:23.373 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:32:23.415 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:32:23.436 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:32:23.792 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 127/156 2024-04-25T10:32:23.819 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T10:32:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 128/156 2024-04-25T10:32:24.088 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 129/156 2024-04-25T10:32:24.122 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T10:32:24.145 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 130/156 2024-04-25T10:32:24.146 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:24.146 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T10:32:24.146 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T10:32:24.146 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T10:32:24.146 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:24.189 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T10:32:24.200 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 131/156 2024-04-25T10:32:24.256 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T10:32:24.298 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 132/156 2024-04-25T10:32:24.345 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T10:32:24.346 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 133/156 2024-04-25T10:32:24.386 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T10:32:24.475 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T10:32:24.508 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T10:32:24.508 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T10:32:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T10:32:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T10:32:24.633 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T10:32:24.725 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T10:32:24.797 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:32:25.296 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T10:32:25.325 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T10:32:25.348 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 135/156 2024-04-25T10:32:25.348 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:25.348 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T10:32:25.349 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:32:25.349 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:32:25.349 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:25.392 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T10:32:25.415 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3291.g994e2 136/156 2024-04-25T10:32:25.415 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:25.415 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T10:32:25.415 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:25.459 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T10:32:25.482 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 137/156 2024-04-25T10:32:25.482 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:25.482 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T10:32:25.482 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:32:25.483 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:32:25.483 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:25.802 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T10:32:25.825 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 138/156 2024-04-25T10:32:25.825 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T10:32:25.825 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T10:32:25.825 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T10:32:25.826 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T10:32:25.826 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:30.107 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 139/156 2024-04-25T10:32:30.148 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 140/156 2024-04-25T10:32:30.188 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 141/156 2024-04-25T10:32:30.220 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T10:32:30.248 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T10:32:30.434 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 144/156 2024-04-25T10:32:30.486 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T10:32:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 146/156 2024-04-25T10:32:30.920 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:32:30.920 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T10:32:30.920 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T10:32:30.920 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T10:32:30.920 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T10:32:30.921 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T10:32:30.922 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T10:32:30.923 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T10:32:30.924 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T10:32:30.925 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T10:32:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T10:32:30.927 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T10:32:30.928 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T10:32:30.929 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T10:32:30.930 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T10:32:30.931 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T10:32:30.931 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T10:32:31.140 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:32:31.180 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:32:31.200 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T10:32:32.045 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 148/156 2024-04-25T10:32:32.136 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T10:32:32.177 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T10:32:32.261 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T10:32:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T10:32:32.292 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T10:32:32.376 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T10:32:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T10:32:32.409 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T10:32:32.492 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T10:32:32.558 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:32:32.959 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T10:32:32.960 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.961 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T10:32:32.962 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T10:32:32.963 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T10:32:32.963 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T10:32:32.963 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T10:32:32.963 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T10:32:32.963 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T10:32:32.963 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T10:32:32.963 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T10:32:32.963 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T10:32:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T10:32:32.965 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T10:32:32.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T10:32:32.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T10:32:32.968 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T10:32:32.969 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T10:32:32.970 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T10:32:32.971 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T10:32:32.972 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T10:32:32.972 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:32.972 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-25T10:32:33.418 DEBUG:teuthology.parallel:result is None 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 1/156 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2/156 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 3/156 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 4/156 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3291.g994e2 5/156 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 6/156 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 7/156 2024-04-25T10:32:38.674 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 8/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 9/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 10/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 11/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 12/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 13/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 14/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_ 15/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 16/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 17/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_6 18/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86 19/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 20/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el 21/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.0.0-3291.g994e2f20.el9. 22/156 2024-04-25T10:32:38.675 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_6 23/156 2024-04-25T10:32:38.676 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 24/156 2024-04-25T10:32:38.676 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 25/156 2024-04-25T10:32:38.676 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 26/156 2024-04-25T10:32:38.676 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 27/156 2024-04-25T10:32:38.676 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 28/156 2024-04-25T10:32:38.676 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 29/156 2024-04-25T10:32:38.676 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20. 30/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noa 31/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.n 32/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3291.g994 33/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el 34/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 35/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.e 36/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 37/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 38/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 39/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T10:32:38.688 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T10:32:38.689 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T10:32:38.690 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T10:32:38.691 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T10:32:38.692 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T10:32:38.693 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T10:32:38.694 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T10:32:38.695 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 149/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 151/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T10:32:38.696 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T10:32:40.874 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.875 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.0.0-3291.g994e2f20.el9.noarch 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T10:32:40.876 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T10:32:40.877 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T10:32:40.878 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T10:32:40.879 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T10:32:40.880 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T10:32:40.881 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T10:32:40.882 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T10:32:40.883 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T10:32:40.884 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.0.0-3291.g994e2f20.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T10:32:40.885 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T10:32:40.886 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T10:32:40.886 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:40.886 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-04-25T10:32:41.263 DEBUG:teuthology.parallel:result is None 2024-04-25T10:32:41.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:32:41.479 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T10:32:41.500 INFO:teuthology.orchestra.run.smithi103.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T10:32:41.501 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T10:32:41.501 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T10:32:41.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:32:41.715 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T10:32:41.739 INFO:teuthology.orchestra.run.smithi132.stdout:19.0.0-3291.g994e2f20.el9 2024-04-25T10:32:41.740 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291.g994e2f20.el9 2024-04-25T10:32:41.740 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291.g994e2f20 is installed. 2024-04-25T10:32:41.742 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T10:32:41.742 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:41.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T10:32:41.767 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:32:41.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T10:32:41.809 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T10:32:41.809 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:41.809 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T10:32:41.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T10:32:41.896 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:32:41.896 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T10:32:41.922 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T10:32:41.989 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T10:32:41.989 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:41.989 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T10:32:42.012 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T10:32:42.077 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:32:42.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T10:32:42.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T10:32:42.167 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T10:32:42.168 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:42.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T10:32:42.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T10:32:42.255 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:32:42.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T10:32:42.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T10:32:42.347 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T10:32:42.433 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T10:32:42.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-04-25T10:32:42.436 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-04-25T10:32:42.461 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T10:32:42.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T10:32:42.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T10:32:42.525 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T10:32:42.525 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T10:32:42.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T10:32:42.595 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T10:32:42.595 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T10:32:42.595 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T10:32:42.595 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:42.595 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T10:32:42.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T10:32:42.753 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T10:32:42.777 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:32:42.778 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T10:32:42.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T10:32:42.901 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T10:32:42.944 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T10:32:42.944 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T10:32:42.944 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673084', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPSEtMXgo5NPXrCaP4vEPckIwoFUTIgDWaJP5ToNuivPVmfdgXROTxH+jPOVtvstHwUPFFtlW/4TCtNGk6nYM6c=', 'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtmNHSHcD2jPBDyZLgqNEdOLjEBncgQqQwrzVc9NdKs7YQVkZ1qoftTpIYaM3B3gnNIe4b2sCNUPKmQIHDbP38='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'workunit': {'clients': {'client.0': ['client/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T10:32:42.945 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T10:32:42.947 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T10:32:42.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T10:32:43.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T10:32:43.057 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:43.057 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T10:32:43.081 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T10:32:43.081 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-04-25T10:32:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T10:32:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:32:43.136 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T10:32:43.136 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:32:43.136 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:32:43.136 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-04-25 10:32:32.911530213 +0000 2024-04-25T10:32:43.137 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-04-25 10:30:38.302695268 +0000 2024-04-25T10:32:43.137 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-04-25 10:30:38.302695268 +0000 2024-04-25T10:32:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-04-25 10:30:38.302695268 +0000 2024-04-25T10:32:43.137 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T10:32:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-04-25T10:32:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-04-25T10:32:43.199 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000207296 s, 2.5 MB/s 2024-04-25T10:32:43.200 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T10:32:43.256 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-04-25T10:32:43.310 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T10:32:43.310 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:32:43.310 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T10:32:43.311 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:32:43.311 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:32:43.311 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-04-25 10:32:32.911530213 +0000 2024-04-25T10:32:43.311 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-04-25 10:30:38.640688321 +0000 2024-04-25T10:32:43.311 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-04-25 10:30:38.640688321 +0000 2024-04-25T10:32:43.311 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-04-25 10:30:38.640688321 +0000 2024-04-25T10:32:43.311 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T10:32:43.373 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-04-25T10:32:43.373 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-04-25T10:32:43.373 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000214232 s, 2.4 MB/s 2024-04-25T10:32:43.374 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T10:32:43.430 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-04-25T10:32:43.485 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T10:32:43.485 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:32:43.485 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T10:32:43.485 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:32:43.485 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:32:43.485 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-04-25 10:32:32.912530194 +0000 2024-04-25T10:32:43.485 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-04-25 10:30:38.975681435 +0000 2024-04-25T10:32:43.485 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-04-25 10:30:38.975681435 +0000 2024-04-25T10:32:43.486 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-04-25 10:30:38.975681435 +0000 2024-04-25T10:32:43.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T10:32:43.547 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-04-25T10:32:43.547 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-04-25T10:32:43.547 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000256705 s, 2.0 MB/s 2024-04-25T10:32:43.548 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T10:32:43.604 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-04-25 10:32:32.912530194 +0000 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-04-25 10:30:39.298674795 +0000 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-04-25 10:30:39.298674795 +0000 2024-04-25T10:32:43.659 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-04-25 10:30:39.298674795 +0000 2024-04-25T10:32:43.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T10:32:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-04-25T10:32:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-04-25T10:32:43.721 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000190469 s, 2.7 MB/s 2024-04-25T10:32:43.723 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T10:32:43.779 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:32:43.779 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:32:43.779 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T10:32:43.795 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T10:32:43.795 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-04-25T10:32:43.851 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T10:32:43.851 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:32:43.851 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T10:32:43.851 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:32:43.851 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:32:43.851 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-25 10:32:25.157060240 +0000 2024-04-25T10:32:43.852 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-25 10:30:38.338078339 +0000 2024-04-25T10:32:43.852 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-25 10:30:38.338078339 +0000 2024-04-25T10:32:43.852 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-25 10:30:38.338078339 +0000 2024-04-25T10:32:43.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T10:32:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-25T10:32:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-25T10:32:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000190259 s, 2.7 MB/s 2024-04-25T10:32:43.917 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T10:32:43.974 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-04-25T10:32:44.030 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T10:32:44.030 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:32:44.030 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-04-25T10:32:44.031 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:32:44.031 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:32:44.031 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-25 10:32:25.157060240 +0000 2024-04-25T10:32:44.031 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-25 10:30:38.687068909 +0000 2024-04-25T10:32:44.031 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-25 10:30:38.687068909 +0000 2024-04-25T10:32:44.031 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-25 10:30:38.687068909 +0000 2024-04-25T10:32:44.031 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T10:32:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-25T10:32:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-25T10:32:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000228237 s, 2.2 MB/s 2024-04-25T10:32:44.095 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T10:32:44.152 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-04-25T10:32:44.207 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T10:32:44.208 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:32:44.208 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-25T10:32:44.208 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:32:44.208 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:32:44.208 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-25 10:32:25.158060214 +0000 2024-04-25T10:32:44.208 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-25 10:30:39.024059803 +0000 2024-04-25T10:32:44.208 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-25 10:30:39.024059803 +0000 2024-04-25T10:32:44.208 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-25 10:30:39.024059803 +0000 2024-04-25T10:32:44.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T10:32:44.270 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-25T10:32:44.270 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-25T10:32:44.270 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000190344 s, 2.7 MB/s 2024-04-25T10:32:44.271 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T10:32:44.327 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-25 10:32:25.158060214 +0000 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-25 10:30:39.375050319 +0000 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-25 10:30:39.375050319 +0000 2024-04-25T10:32:44.383 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-25 10:30:39.375050319 +0000 2024-04-25T10:32:44.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T10:32:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-25T10:32:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-25T10:32:44.444 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000204609 s, 2.5 MB/s 2024-04-25T10:32:44.445 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T10:32:44.500 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:32:44.501 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T10:32:44.501 INFO:tasks.ceph:Generating config... 2024-04-25T10:32:44.502 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T10:32:44.502 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T10:32:44.502 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T10:32:44.502 INFO:tasks.ceph:[client] pid file = 2024-04-25T10:32:44.502 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T10:32:44.502 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T10:32:44.502 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T10:32:44.502 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T10:32:44.502 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T10:32:44.502 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T10:32:44.503 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T10:32:44.503 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T10:32:44.504 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T10:32:44.505 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T10:32:44.505 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T10:32:44.577 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T10:32:44.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T10:32:44.633 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:32:44.656 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.103'), ('mon.b', '172.21.15.132'), ('mon.c', '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]')] 2024-04-25T10:32:44.656 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.103,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T10:32:44.657 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:44.657 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T10:32:44.711 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.103 --add b 172.21.15.132 --addv c '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:32:44.861 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:32:44.861 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: generated fsid e6dc88b0-adc9-49ee-9cbd-a80811a8e643 2024-04-25T10:32:44.861 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-04-25T10:32:44.861 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 0 2024-04-25T10:32:44.861 INFO:teuthology.orchestra.run.smithi103.stdout:fsid e6dc88b0-adc9-49ee-9cbd-a80811a8e643 2024-04-25T10:32:44.862 INFO:teuthology.orchestra.run.smithi103.stdout:last_changed 2024-04-25T10:32:44.860558+0000 2024-04-25T10:32:44.862 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-04-25T10:32:44.860558+0000 2024-04-25T10:32:44.862 INFO:teuthology.orchestra.run.smithi103.stdout:min_mon_release 17 (quincy) 2024-04-25T10:32:44.862 INFO:teuthology.orchestra.run.smithi103.stdout:election_strategy: 1 2024-04-25T10:32:44.862 INFO:teuthology.orchestra.run.smithi103.stdout:0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-04-25T10:32:44.862 INFO:teuthology.orchestra.run.smithi103.stdout:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2024-04-25T10:32:44.862 INFO:teuthology.orchestra.run.smithi103.stdout:2: [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] mon.c 2024-04-25T10:32:44.862 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T10:32:44.863 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T10:32:44.877 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e6dc88b0-adc9-49ee-9cbd-a80811a8e643... 2024-04-25T10:32:44.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:32:44.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:32:44.957 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-04-25T10:32:44.957 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:32:44.958 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:32:44.959 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.103,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = e6dc88b0-adc9-49ee-9cbd-a80811a8e643 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.960 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-04-25T10:32:44.961 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: bdev async discard = True 2024-04-25T10:32:44.962 INFO:teuthology.orchestra.run.smithi103.stdout: bdev enable discard = True 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore allocator = bitmap 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 1/20 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 1/20 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 4/10 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.963 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-04-25T10:32:44.964 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.965 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: mon down mkfs grace = 300 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: mon op complaint time = 120 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: client mount timeout = 600 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-04-25T10:32:44.966 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = "" 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout:[mds] 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds = 20 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds balancer = 20 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug frag = True 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug scatterstat = True 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: mds op complaint time = 180 2024-04-25T10:32:44.967 INFO:teuthology.orchestra.run.smithi103.stdout: mds verify scatter = True 2024-04-25T10:32:44.968 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-04-25T10:32:44.968 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-04-25T10:32:44.968 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-04-25T10:32:44.968 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-04-25T10:32:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-04-25T10:32:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:32:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-04-25T10:32:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.103,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = e6dc88b0-adc9-49ee-9cbd-a80811a8e643 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-04-25T10:32:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-04-25T10:32:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-04-25T10:32:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-04-25T10:32:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-04-25T10:32:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-04-25T10:32:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: mon down mkfs grace = 300 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T10:32:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = "" 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2024-04-25T10:32:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2024-04-25T10:32:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-04-25T10:32:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-04-25T10:32:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-04-25T10:32:44.980 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T10:32:44.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T10:32:45.082 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T10:32:45.082 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:45.082 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T10:32:45.097 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:45.097 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T10:32:45.152 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:32:45.152 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:45.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T10:32:45.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:32:45.224 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:32:45.224 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:32:45.279 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:32:45.279 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:32:45.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T10:32:45.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:32:45.312 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:32:45.312 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:32:45.367 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T10:32:45.367 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T10:32:45.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T10:32:45.425 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T10:32:45.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T10:32:45.521 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T10:32:45.527 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T10:32:45.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T10:32:45.584 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T10:32:45.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T10:32:45.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T10:32:45.670 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T10:32:45.673 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T10:32:45.696 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T10:32:45.697 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T10:32:45.746 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T10:32:45.759 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T10:32:45.759 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T10:32:45.759 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T10:32:45.782 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:32:45.782 INFO:tasks.ceph:role: osd.0 2024-04-25T10:32:45.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:32:45.783 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T10:32:45.853 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:32:45.853 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:32:45.853 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:32:45.853 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:32:45.853 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:32:45.853 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:32:45.853 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:32:45.853 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:32:45.854 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:32:45.854 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:32:46.367 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-04-25T10:32:46.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-04-25T10:32:46.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T10:32:46.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T10:32:46.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T10:32:46.599 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:32:46.599 INFO:tasks.ceph:role: osd.1 2024-04-25T10:32:46.599 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:32:46.599 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T10:32:46.671 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:32:46.671 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:32:46.671 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:32:46.671 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:32:46.671 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:32:46.671 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:32:46.672 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:32:46.672 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:32:46.672 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:32:46.672 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:32:47.121 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-04-25T10:32:47.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-04-25T10:32:47.123 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T10:32:47.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T10:32:47.237 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T10:32:47.302 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:32:47.302 INFO:tasks.ceph:role: osd.2 2024-04-25T10:32:47.303 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:32:47.303 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T10:32:47.374 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:32:47.374 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:32:47.374 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:32:47.374 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:32:47.374 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:32:47.374 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:32:47.374 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:32:47.374 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:32:47.375 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:32:47.375 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:32:47.864 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-04-25T10:32:47.866 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-04-25T10:32:47.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T10:32:48.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T10:32:48.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T10:32:48.095 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:32:48.095 INFO:tasks.ceph:role: osd.3 2024-04-25T10:32:48.095 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:32:48.095 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T10:32:48.167 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:32:48.167 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:32:48.167 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:32:48.168 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:32:48.168 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:32:48.168 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:32:48.168 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:32:48.168 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:32:48.168 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:32:48.168 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:32:48.678 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-04-25T10:32:48.680 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-04-25T10:32:48.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T10:32:48.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T10:32:48.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:32:48.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:48.967+0000 7f540ae61640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T10:32:48.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:48.967+0000 7f540ae61640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T10:32:48.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:48.967+0000 7f540ae61640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:32:48.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:48.967+0000 7f540ae61640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:32:48.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:48.967+0000 7f540ae61640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:32:48.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:48.968+0000 7f540ae61640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T10:32:51.820 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T10:32:51.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:32:51.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:51.947+0000 7f87fa5be640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T10:32:51.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:51.947+0000 7f87fa5be640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T10:32:51.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:51.947+0000 7f87fa5be640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:32:51.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:51.947+0000 7f87fa5be640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:32:51.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:51.947+0000 7f87fa5be640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:32:51.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:51.948+0000 7f87fa5be640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T10:32:54.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T10:32:54.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:32:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:54.928+0000 7f409ff57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T10:32:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:54.929+0000 7f409ff57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T10:32:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:54.929+0000 7f409ff57640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:32:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:54.929+0000 7f409ff57640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:32:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:54.929+0000 7f409ff57640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:32:54.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:54.929+0000 7f409ff57640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T10:32:57.792 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T10:32:57.820 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:32:57.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:57.920+0000 7f5ff6215640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T10:32:57.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:57.921+0000 7f5ff6215640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T10:32:57.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:57.921+0000 7f5ff6215640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:32:57.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:57.921+0000 7f5ff6215640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:32:57.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:57.921+0000 7f5ff6215640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:32:57.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:32:57.921+0000 7f5ff6215640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T10:33:00.766 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T10:33:00.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T10:33:00.825 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:33:00.825 INFO:tasks.ceph:role: osd.4 2024-04-25T10:33:00.826 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:33:00.826 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T10:33:00.903 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:33:00.904 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:33:01.368 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-25T10:33:01.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-25T10:33:01.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T10:33:01.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T10:33:01.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T10:33:01.599 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:33:01.599 INFO:tasks.ceph:role: osd.5 2024-04-25T10:33:01.600 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:33:01.600 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T10:33:01.672 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:33:01.672 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:33:01.673 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:33:01.673 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:33:01.673 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:33:01.673 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:33:01.673 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:33:01.673 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:33:01.673 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:33:01.673 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:33:02.137 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-25T10:33:02.139 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-25T10:33:02.139 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T10:33:02.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T10:33:02.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T10:33:02.351 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:33:02.351 INFO:tasks.ceph:role: osd.6 2024-04-25T10:33:02.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:33:02.352 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T10:33:02.423 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:33:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:33:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:33:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:33:02.424 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:33:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:33:02.424 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:33:02.424 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:33:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:33:02.424 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:33:02.906 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-25T10:33:02.908 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-25T10:33:02.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T10:33:03.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T10:33:03.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T10:33:03.105 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:33:03.105 INFO:tasks.ceph:role: osd.7 2024-04-25T10:33:03.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:33:03.105 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T10:33:03.177 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:33:03.178 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:33:03.706 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-25T10:33:03.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-25T10:33:03.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T10:33:03.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T10:33:03.878 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:33:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:03.978+0000 7fb19980d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T10:33:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:03.983+0000 7fb19980d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T10:33:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:03.983+0000 7fb19980d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:33:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:03.983+0000 7fb19980d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:33:03.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:03.983+0000 7fb19980d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:33:03.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:03.984+0000 7fb19980d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T10:33:06.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T10:33:06.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:33:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:06.955+0000 7f9505dd8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T10:33:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:06.956+0000 7f9505dd8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T10:33:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:06.956+0000 7f9505dd8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:33:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:06.956+0000 7f9505dd8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:33:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:06.956+0000 7f9505dd8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:33:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:06.956+0000 7f9505dd8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T10:33:09.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T10:33:09.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:33:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:09.945+0000 7f1783e10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T10:33:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:09.945+0000 7f1783e10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T10:33:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:09.945+0000 7f1783e10640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:33:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:09.945+0000 7f1783e10640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:33:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:09.945+0000 7f1783e10640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:33:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:09.946+0000 7f1783e10640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T10:33:12.804 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T10:33:12.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:33:12.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:12.929+0000 7efdf2818640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T10:33:12.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:12.930+0000 7efdf2818640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T10:33:12.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:12.930+0000 7efdf2818640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:33:12.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:12.930+0000 7efdf2818640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:33:12.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:12.930+0000 7efdf2818640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:33:12.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:12.930+0000 7efdf2818640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T10:33:12.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:33:12.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:33:15.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T10:33:15.810 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T10:33:15.811 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:15.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T10:33:15.839 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:15.839 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T10:33:15.906 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:15.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T10:33:15.972 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:15.972 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T10:33:16.037 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:16.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T10:33:16.101 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:16.102 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T10:33:16.165 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:16.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T10:33:16.194 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:16.194 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T10:33:16.262 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:16.262 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T10:33:16.328 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:16.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T10:33:16.395 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:16.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T10:33:16.460 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:16.461 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T10:33:16.525 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:16.525 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T10:33:16.541 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T10:33:16.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T10:33:16.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T10:33:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2024-04-25T10:33:16.605 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBNMSpmr0dOGRAAnRo0ucprig+GJAGHxLHDLg== 2024-04-25T10:33:16.605 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-04-25T10:33:16.605 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBNMSpmnMjLIhAAIv/c5DOIPjKM6NFmIQirfg== 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBQMSpmXlSwORAAHYMBBO48Z31kRBkgkWgaGA== 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBTMSpm4I98OBAAc72lyzcbDucH6eNkN8kWsA== 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBWMSpmcw1nNxAAopmTnXO+KHjJajiHp1kV8w== 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBZMSpmQT3rNhAAaVL9hmmWONEM7oZdc4S/Aw== 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBNMSpm09EEHxAAAp5SlsQ5grHXKgPg/rR+cQ== 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBNMSpmpc7mJxAA/lEX40I1e+RzQ/yv/z7gRg== 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2024-04-25T10:33:16.606 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBfMSpmxLhfOhAAJfxETW6nTnaAJS2DV+Zsrw== 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBiMSpmLNEVORAAR7XveW/1sK/7RinorEh21A== 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBlMSpmWAtwOBAA0h4Bxvb1R83mJz/i/RC/ZQ== 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBoMSpmOOSFNxAAov26175eYsD7gL03gxdjCw== 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBNMSpmUhBxLBAAy73zAQU7wWxWGsxW5UkHbA== 2024-04-25T10:33:16.607 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBNMSpmr0dOGRAAnRo0ucprig+GJAGHxLHDLg== 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBNMSpmnMjLIhAAIv/c5DOIPjKM6NFmIQirfg== 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBQMSpmXlSwORAAHYMBBO48Z31kRBkgkWgaGA== 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBTMSpm4I98OBAAc72lyzcbDucH6eNkN8kWsA== 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBWMSpmcw1nNxAAopmTnXO+KHjJajiHp1kV8w== 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBZMSpmQT3rNhAAaVL9hmmWONEM7oZdc4S/Aw== 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBNMSpm09EEHxAAAp5SlsQ5grHXKgPg/rR+cQ== 2024-04-25T10:33:16.608 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBNMSpmpc7mJxAA/lEX40I1e+RzQ/yv/z7gRg== 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBfMSpmxLhfOhAAJfxETW6nTnaAJS2DV+Zsrw== 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBiMSpmLNEVORAAR7XveW/1sK/7RinorEh21A== 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBlMSpmWAtwOBAA0h4Bxvb1R83mJz/i/RC/ZQ== 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBoMSpmOOSFNxAAov26175eYsD7gL03gxdjCw== 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-04-25T10:33:16.609 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBNMSpmUhBxLBAAy73zAQU7wWxWGsxW5UkHbA== 2024-04-25T10:33:16.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:33:16.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:33:16.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:33:16.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:33:16.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:16.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:16.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:16.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:16.898 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:16.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:16.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:16.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:33:17.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:33:17.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:33:17.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:33:17.142 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.144 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.203 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.266 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.325 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:33:17.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:33:17.388 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:33:17.450 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T10:33:17.450 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T10:33:17.473 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:33:17.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T10:33:17.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T10:33:17.625 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:33:17.732 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T10:33:17.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T10:33:17.819 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:33:17.923 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T10:33:17.946 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:33:17.949 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:33:18.001 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T10:33:18.001 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T10:33:18.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T10:33:18.004 INFO:tasks.ceph.mon.a:Started 2024-04-25T10:33:18.004 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T10:33:18.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T10:33:18.044 INFO:tasks.ceph.mon.b:Started 2024-04-25T10:33:18.044 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T10:33:18.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T10:33:18.046 INFO:tasks.ceph.mon.c:Started 2024-04-25T10:33:18.046 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T10:33:18.046 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T10:33:18.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T10:33:18.049 INFO:tasks.ceph.mgr.y:Started 2024-04-25T10:33:18.049 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T10:33:18.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T10:33:18.051 INFO:tasks.ceph.mgr.x:Started 2024-04-25T10:33:18.051 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T10:33:18.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T10:33:18.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.157+0000 7f0b11205640 1 Processor -- start 2024-04-25T10:33:18.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.158+0000 7f0b11205640 1 -- start start 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b11205640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 0x7f0b0c0b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b11205640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 0x7f0b0c146210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b11205640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0c0b68e0 con 0x7f0b0c0b7e70 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b11205640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0b0c0b6690 con 0x7f0b0c0b5bc0 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b11205640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0c0b6f30 con 0x7f0b0c0b2630 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b03fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 0x7f0b0c0b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b03fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 0x7f0b0c0b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34650/0 (socket says 172.21.15.103:34650) 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b03fff640 1 -- 172.21.15.103:0/1013270705 learned_addr learned my addr 172.21.15.103:0/1013270705 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:18.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b0ad9d640 1 --1- 172.21.15.103:0/1013270705 >> v1:172.21.15.103:6789/0 conn(0x7f0b0c0b7e70 0x7f0b0c0b54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57854/0 (socket says 172.21.15.103:57854) 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b03fff640 1 -- 172.21.15.103:0/1013270705 >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 msgr2=0x7f0b0c0b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b03fff640 1 -- 172.21.15.103:0/1013270705 >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 msgr2=0x7f0b0c0b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1013270705 >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 0x7f0b0c0b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1013270705 >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 0x7f0b0c0b2e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b0b59e640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 0x7f0b0c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b0b59e640 1 -- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 msgr2=0x7f0b0c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b0b59e640 1 -- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 msgr2=0x7f0b0c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b0b59e640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 0x7f0b0c146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:33:18.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.159+0000 7f0b0b59e640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 0x7f0b0c146210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828854602 0 0) 0x7f0b0c0b68e0 con 0x7f0b0c0b7e70 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0af8003520 con 0x7f0b0c0b7e70 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3515435658 0 0) 0x7f0af8003520 con 0x7f0b0c0b7e70 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 msgr2=0x7f0b0c146210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 0x7f0b0c146210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 msgr2=0x7f0b0c0b2e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 --2- 172.21.15.103:0/1013270705 >> v2:172.21.15.103:3300/0 conn(0x7f0b0c0b5bc0 0x7f0b0c0b2e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c0b6bc0 con 0x7f0b0c0b7e70 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.314+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f0afc001690 con 0x7f0b0c0b7e70 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 >> v1:172.21.15.103:6789/0 conn(0x7f0b0c0b7e70 legacy=0x7f0b0c0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0a59c640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af80039b0 0x7f0af8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0a59c640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8004800 0x7f0af8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0a59c640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 0x7f0af80052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0b6690 con 0x7f0af8004800 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0b6f30 con 0x7f0af80039b0 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f0af800bbd0 con 0x7f0b0c0b2630 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8004800 0x7f0af8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0ad9d640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af80039b0 0x7f0af8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b0b59e640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 0x7f0af80052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b03fff640 1 -- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 msgr2=0x7f0af80052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c0b2630 0x7f0af80052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b03fff640 1 -- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af80039b0 msgr2=0x7f0af8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af80039b0 0x7f0af8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.315+0000 7f0b03fff640 1 -- 172.21.15.103:0/1013270705 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af8003520 con 0x7f0af8004800 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.316+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8004800 0x7f0af8004c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0af400bd40 tx=0x7f0af8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b52560d67d822db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:18.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.316+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af403a070 con 0x7f0af8004800 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.316+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af402da00 con 0x7f0af8004800 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.316+0000 7f0b0a59c640 1 -- 172.21.15.103:0/1013270705 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af400b940 con 0x7f0af8004800 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.317+0000 7f0b11205640 1 -- 172.21.15.103:0/1013270705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8004800 msgr2=0x7f0af8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.317+0000 7f0b11205640 1 --2- 172.21.15.103:0/1013270705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8004800 0x7f0af8004c10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0af400bd40 tx=0x7f0af8005830 comp rx=0 tx=0).stop 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.317+0000 7f0b0b59e640 1 -- 172.21.15.103:0/1013270705 reap_dead start 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.317+0000 7f0b11205640 1 -- 172.21.15.103:0/1013270705 shutdown_connections 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.317+0000 7f0b11205640 1 -- 172.21.15.103:0/1013270705 >> 172.21.15.103:0/1013270705 conn(0x7f0b0c06e920 msgr2=0x7f0b0c0bb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.317+0000 7f0b11205640 1 -- 172.21.15.103:0/1013270705 shutdown_connections 2024-04-25T10:33:18.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.317+0000 7f0b11205640 1 -- 172.21.15.103:0/1013270705 wait complete. 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.318+0000 7f0b11205640 1 Processor -- start 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.318+0000 7f0b11205640 1 -- start start 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.319+0000 7f0b11205640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af8004800 0x7f0b0c1cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.319+0000 7f0b11205640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0c1d1900 0x7f0b0c143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.319+0000 7f0b11205640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c13de90 0x7f0b0c13e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.319+0000 7f0b11205640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c146210 con 0x7f0b0c1d1900 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.319+0000 7f0b11205640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c0b3660 con 0x7f0af8004800 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.319+0000 7f0b11205640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0c146390 con 0x7f0b0c13de90 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0c1d1900 0x7f0b0c143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0c1d1900 0x7f0b0c143330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34676/0 (socket says 172.21.15.103:34676) 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 -- 172.21.15.103:0/1673925200 learned_addr learned my addr 172.21.15.103:0/1673925200 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:18.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b0b59e640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c13de90 0x7f0b0c13e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b0ad9d640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af8004800 0x7f0b0c1cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 -- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c13de90 msgr2=0x7f0b0c13e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c13de90 0x7f0b0c13e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 -- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af8004800 msgr2=0x7f0b0c1cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af8004800 0x7f0b0c1cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 -- 172.21.15.103:0/1673925200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c1d1db0 con 0x7f0b0c1d1900 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b0ad9d640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af8004800 0x7f0b0c1cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b03fff640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0c1d1900 0x7f0b0c143330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0af402d4f0 tx=0x7f0af4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b037fe640 1 -- 172.21.15.103:0/1673925200 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4044020 con 0x7f0b0c1d1900 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b037fe640 1 -- 172.21.15.103:0/1673925200 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af402d800 con 0x7f0b0c1d1900 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0c1d2050 con 0x7f0b0c1d1900 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b037fe640 1 -- 172.21.15.103:0/1673925200 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af403a040 con 0x7f0b0c1d1900 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0c1d13e0 con 0x7f0b0c1d1900 2024-04-25T10:33:18.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b037fe640 1 -- 172.21.15.103:0/1673925200 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0af4047020 con 0x7f0b0c1d1900 2024-04-25T10:33:18.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.320+0000 7f0b037fe640 1 -- 172.21.15.103:0/1673925200 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0af4040da0 con 0x7f0b0c1d1900 2024-04-25T10:33:18.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.321+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0c06a130 con 0x7f0b0c1d1900 2024-04-25T10:33:18.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.323+0000 7f0b037fe640 1 -- 172.21.15.103:0/1673925200 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0af404e030 con 0x7f0b0c1d1900 2024-04-25T10:33:18.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.390+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0b0c1ce3a0 con 0x7f0b0c1d1900 2024-04-25T10:33:18.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.392+0000 7f0b037fe640 1 -- 172.21.15.103:0/1673925200 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0af402d9b0 con 0x7f0b0c1d1900 2024-04-25T10:33:18.397 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-04-25T10:33:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0c1d1900 msgr2=0x7f0b0c143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0c1d1900 0x7f0b0c143330 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0af402d4f0 tx=0x7f0af4004730 comp rx=0 tx=0).stop 2024-04-25T10:33:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 shutdown_connections 2024-04-25T10:33:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0b0c13de90 0x7f0b0c13e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0c1d1900 0x7f0b0c143330 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 --2- 172.21.15.103:0/1673925200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0af8004800 0x7f0b0c1cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 >> 172.21.15.103:0/1673925200 conn(0x7f0b0c06e920 msgr2=0x7f0b0c075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 shutdown_connections 2024-04-25T10:33:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:18.393+0000 7f0b11205640 1 -- 172.21.15.103:0/1673925200 wait complete. 2024-04-25T10:33:18.407 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T10:33:18.407 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T10:33:18.407 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:18.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T10:33:18.433 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:18.433 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T10:33:18.441 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:18.439+0000 7f65d0c10040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T10:33:18.453 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:18.451+0000 7fac10419040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T10:33:18.477 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:18.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T10:33:18.541 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:33:18.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T10:33:18.583 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:18.582+0000 7f65d0c10040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:33:18.604 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:18.604 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T10:33:18.611 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:18.609+0000 7fac10419040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:33:18.629 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:18.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T10:33:18.638 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:18.636+0000 7f65d0c10040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T10:33:18.661 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:18.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T10:33:18.665 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:18.662+0000 7fac10419040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T10:33:18.725 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T10:33:18.725 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T10:33:18.789 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 8a3de346-8fd7-4fca-97cd-ab94a99c5602 0 2024-04-25T10:33:18.905 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:18.903+0000 7f65d0c10040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T10:33:18.919 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:18.917+0000 7fac10419040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T10:33:18.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.935+0000 7f74b3677640 1 Processor -- start 2024-04-25T10:33:18.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.935+0000 7f74b3677640 1 -- start start 2024-04-25T10:33:18.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.936+0000 7f74b3677640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74ac072940 0x7f74ac0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b3677640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74ac0b80b0 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b3677640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74ac0b27a0 con 0x7f74ac141780 2024-04-25T10:33:18.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b3677640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f74ac0b7780 con 0x7f74ac072940 2024-04-25T10:33:18.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b1c14640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f74ac141780 0x7f74ac151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40036/0 (socket says 172.21.15.132:40036) 2024-04-25T10:33:18.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b1c14640 1 -- 172.21.15.132:0/1900706769 learned_addr learned my addr 172.21.15.132:0/1900706769 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T10:33:18.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b1413640 1 --2- 172.21.15.132:0/1900706769 >> v2:172.21.15.103:3300/0 conn(0x7f74ac072940 0x7f74ac0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74a3fff640 1 -- 172.21.15.132:0/1900706769 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949224001 0 0) 0x7f74ac0b27a0 con 0x7f74ac141780 2024-04-25T10:33:18.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74a3fff640 1 -- 172.21.15.132:0/1900706769 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7498003520 con 0x7f74ac141780 2024-04-25T10:33:18.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74a3fff640 1 -- 172.21.15.132:0/1900706769 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154560844 0 0) 0x7f74ac0b80b0 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74a3fff640 1 -- 172.21.15.132:0/1900706769 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74ac0b27a0 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b1413640 1 -- 172.21.15.132:0/1900706769 >> v1:172.21.15.132:6789/0 conn(0x7f74ac141780 legacy=0x7f74ac151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b1413640 1 -- 172.21.15.132:0/1900706769 >> v1:172.21.15.103:6789/0 conn(0x7f74ac0b7ca0 legacy=0x7f74ac141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.937+0000 7f74b1413640 1 -- 172.21.15.132:0/1900706769 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac0b2450 con 0x7f74ac072940 2024-04-25T10:33:18.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.938+0000 7f74b1413640 1 --2- 172.21.15.132:0/1900706769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 0x7f74ac0b51d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f749c0097a0 tx=0x7f749c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9fa15195b41451 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:18.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.938+0000 7f74a3fff640 1 -- 172.21.15.132:0/1900706769 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c037070 con 0x7f74ac072940 2024-04-25T10:33:18.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.938+0000 7f74a3fff640 1 -- 172.21.15.132:0/1900706769 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749c032440 con 0x7f74ac072940 2024-04-25T10:33:18.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.938+0000 7f74a3fff640 1 -- 172.21.15.132:0/1900706769 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c032810 con 0x7f74ac072940 2024-04-25T10:33:18.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.939+0000 7f74b3677640 1 -- 172.21.15.132:0/1900706769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 msgr2=0x7f74ac0b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.939+0000 7f74b3677640 1 --2- 172.21.15.132:0/1900706769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 0x7f74ac0b51d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f749c0097a0 tx=0x7f749c02a230 comp rx=0 tx=0).stop 2024-04-25T10:33:18.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.939+0000 7f74b3677640 1 -- 172.21.15.132:0/1900706769 shutdown_connections 2024-04-25T10:33:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.939+0000 7f74b3677640 1 --2- 172.21.15.132:0/1900706769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 0x7f74ac0b51d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.939+0000 7f74b3677640 1 -- 172.21.15.132:0/1900706769 >> 172.21.15.132:0/1900706769 conn(0x7f74ac06e0c0 msgr2=0x7f74ac0bb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.939+0000 7f74b3677640 1 -- 172.21.15.132:0/1900706769 shutdown_connections 2024-04-25T10:33:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.939+0000 7f74b3677640 1 -- 172.21.15.132:0/1900706769 wait complete. 2024-04-25T10:33:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.940+0000 7f74b3677640 1 Processor -- start 2024-04-25T10:33:18.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.941+0000 7f74b3677640 1 -- start start 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.941+0000 7f74b3677640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 0x7f74ac1de220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.941+0000 7f74b3677640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74ac0b7ca0 0x7f74ac13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.941+0000 7f74b3677640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74ac141780 0x7f74ac14aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.941+0000 7f74b3677640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac073a60 con 0x7f74ac072940 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.941+0000 7f74b3677640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac0738e0 con 0x7f74ac141780 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.941+0000 7f74b3677640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f74ac073be0 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74ac0b7ca0 0x7f74ac13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b1c14640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74ac141780 0x7f74ac14aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74ac0b7ca0 0x7f74ac13fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33506/0 (socket says 172.21.15.132:33506) 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 -- 172.21.15.132:0/642716821 learned_addr learned my addr 172.21.15.132:0/642716821 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b1413640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 0x7f74ac1de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 -- 172.21.15.132:0/642716821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74ac141780 msgr2=0x7f74ac14aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74ac141780 0x7f74ac14aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 -- 172.21.15.132:0/642716821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 msgr2=0x7f74ac1de220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 0x7f74ac1de220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 -- 172.21.15.132:0/642716821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac140470 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b1c14640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74ac141780 0x7f74ac14aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b1413640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 0x7f74ac1de220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b0c12640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74ac0b7ca0 0x7f74ac13fc90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c460 tx=0x7f74a800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74a1ffb640 1 -- 172.21.15.132:0/642716821 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8017070 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74a1ffb640 1 -- 172.21.15.132:0/642716821 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a80052f0 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ac1d18b0 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.942+0000 7f74a1ffb640 1 -- 172.21.15.132:0/642716821 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8003830 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.943+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ac1dda20 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.943+0000 7f74a1ffb640 1 -- 172.21.15.132:0/642716821 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f74a801a070 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.943+0000 7f74a1ffb640 1 -- 172.21.15.132:0/642716821 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f74a801c440 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.944+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74ac06a130 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:18.946+0000 7f74a1ffb640 1 -- 172.21.15.132:0/642716821 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f74a8021080 con 0x7f74ac0b7ca0 2024-04-25T10:33:18.953 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:18.952+0000 7f65d0c10040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T10:33:18.966 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:18.964+0000 7fac10419040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T10:33:19.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.018+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8a3de346-8fd7-4fca-97cd-ab94a99c5602", "id": 0} v 0) -- 0x7f74ac0bc6f0 con 0x7f74ac0b7ca0 2024-04-25T10:33:19.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.022+0000 7f74a1ffb640 1 -- 172.21.15.132:0/642716821 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a3de346-8fd7-4fca-97cd-ab94a99c5602", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f74ac140470 con 0x7f74ac0b7ca0 2024-04-25T10:33:19.024 INFO:teuthology.orchestra.run.smithi132.stdout:0 2024-04-25T10:33:19.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74ac0b7ca0 msgr2=0x7f74ac13fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74ac0b7ca0 0x7f74ac13fc90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c460 tx=0x7f74a800c920 comp rx=0 tx=0).stop 2024-04-25T10:33:19.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 shutdown_connections 2024-04-25T10:33:19.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74ac141780 0x7f74ac14aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f74ac0b7ca0 0x7f74ac13fc90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 --2- 172.21.15.132:0/642716821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74ac072940 0x7f74ac1de220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 >> 172.21.15.132:0/642716821 conn(0x7f74ac06e0c0 msgr2=0x7f74ac0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 shutdown_connections 2024-04-25T10:33:19.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.023+0000 7f74b3677640 1 -- 172.21.15.132:0/642716821 wait complete. 2024-04-25T10:33:19.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new d9441759-dca9-44cd-b845-a4157edfe094 1 2024-04-25T10:33:19.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.141+0000 7fcf6fed1640 1 Processor -- start 2024-04-25T10:33:19.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.141+0000 7fcf6fed1640 1 -- start start 2024-04-25T10:33:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.142+0000 7fcf6fed1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf6806d3d0 0x7fcf680b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.142+0000 7fcf6fed1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcf6806d8b0 0x7fcf6814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.142+0000 7fcf6fed1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806dcc0 0x7fcf6814d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.142+0000 7fcf6fed1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6806ef80 con 0x7fcf6806d8b0 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.142+0000 7fcf6fed1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6806f260 con 0x7fcf6806d3d0 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.142+0000 7fcf6fed1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680b6e30 con 0x7fcf6806dcc0 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.142+0000 7fcf6e46e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806dcc0 0x7fcf6814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.142+0000 7fcf6dc6d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf6806d3d0 0x7fcf680b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6e46e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806dcc0 0x7fcf6814d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33512/0 (socket says 172.21.15.132:33512) 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6e46e640 1 -- 172.21.15.132:0/1572106334 learned_addr learned my addr 172.21.15.132:0/1572106334 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6d46c640 1 --2- 172.21.15.132:0/1572106334 >> v2:172.21.15.103:3300/0 conn(0x7fcf6806d8b0 0x7fcf6814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6e46e640 1 -- 172.21.15.132:0/1572106334 >> v2:172.21.15.132:3300/0 conn(0x7fcf6806d3d0 msgr2=0x7fcf680b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6e46e640 1 --2- 172.21.15.132:0/1572106334 >> v2:172.21.15.132:3300/0 conn(0x7fcf6806d3d0 0x7fcf680b68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6e46e640 1 -- 172.21.15.132:0/1572106334 >> v2:172.21.15.103:3300/0 conn(0x7fcf6806d8b0 msgr2=0x7fcf6814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6e46e640 1 --2- 172.21.15.132:0/1572106334 >> v2:172.21.15.103:3300/0 conn(0x7fcf6806d8b0 0x7fcf6814cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6e46e640 1 -- 172.21.15.132:0/1572106334 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6806e3b0 con 0x7fcf6806dcc0 2024-04-25T10:33:19.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.143+0000 7fcf6dc6d640 1 --2- 172.21.15.132:0/1572106334 >> v2:172.21.15.132:3300/0 conn(0x7fcf6806d3d0 0x7fcf680b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:19.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.144+0000 7fcf6e46e640 1 --2- 172.21.15.132:0/1572106334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806dcc0 0x7fcf6814d440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcf68072e20 tx=0x7fcf6002a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79471cee725e2d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:19.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.144+0000 7fcf6cc6b640 1 -- 172.21.15.132:0/1572106334 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60036070 con 0x7fcf6806dcc0 2024-04-25T10:33:19.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.144+0000 7fcf6cc6b640 1 -- 172.21.15.132:0/1572106334 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf60031600 con 0x7fcf6806dcc0 2024-04-25T10:33:19.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.144+0000 7fcf6cc6b640 1 -- 172.21.15.132:0/1572106334 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600319d0 con 0x7fcf6806dcc0 2024-04-25T10:33:19.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.144+0000 7fcf6fed1640 1 -- 172.21.15.132:0/1572106334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806dcc0 msgr2=0x7fcf6814d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.144+0000 7fcf6fed1640 1 --2- 172.21.15.132:0/1572106334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806dcc0 0x7fcf6814d440 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcf68072e20 tx=0x7fcf6002a610 comp rx=0 tx=0).stop 2024-04-25T10:33:19.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.145+0000 7fcf6fed1640 1 -- 172.21.15.132:0/1572106334 shutdown_connections 2024-04-25T10:33:19.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.145+0000 7fcf6fed1640 1 --2- 172.21.15.132:0/1572106334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806dcc0 0x7fcf6814d440 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.145+0000 7fcf6fed1640 1 --2- 172.21.15.132:0/1572106334 >> v2:172.21.15.103:3300/0 conn(0x7fcf6806d8b0 0x7fcf6814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.145+0000 7fcf6fed1640 1 --2- 172.21.15.132:0/1572106334 >> v2:172.21.15.132:3300/0 conn(0x7fcf6806d3d0 0x7fcf680b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.145+0000 7fcf6fed1640 1 -- 172.21.15.132:0/1572106334 >> 172.21.15.132:0/1572106334 conn(0x7fcf6806c5c0 msgr2=0x7fcf6806c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.145+0000 7fcf6fed1640 1 -- 172.21.15.132:0/1572106334 shutdown_connections 2024-04-25T10:33:19.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.145+0000 7fcf6fed1640 1 -- 172.21.15.132:0/1572106334 wait complete. 2024-04-25T10:33:19.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.146+0000 7fcf6fed1640 1 Processor -- start 2024-04-25T10:33:19.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.146+0000 7fcf6fed1640 1 -- start start 2024-04-25T10:33:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6fed1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806d3d0 0x7fcf681d5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6fed1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf6806d8b0 0x7fcf681df6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6fed1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6806dcc0 0x7fcf68141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6fed1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68149550 con 0x7fcf6806d8b0 2024-04-25T10:33:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6fed1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6806ed40 con 0x7fcf6806dcc0 2024-04-25T10:33:19.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6fed1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fcf681496d0 con 0x7fcf6806d3d0 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6dc6d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806d3d0 0x7fcf681d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6e46e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6806dcc0 0x7fcf68141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6dc6d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806d3d0 0x7fcf681d5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33514/0 (socket says 172.21.15.132:33514) 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6dc6d640 1 -- 172.21.15.132:0/3254966478 learned_addr learned my addr 172.21.15.132:0/3254966478 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6d46c640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf6806d8b0 0x7fcf681df6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6e46e640 1 -- 172.21.15.132:0/3254966478 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806d3d0 msgr2=0x7fcf681d5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.147+0000 7fcf6e46e640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806d3d0 0x7fcf681d5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf6e46e640 1 -- 172.21.15.132:0/3254966478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf6806d8b0 msgr2=0x7fcf681df6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf6e46e640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf6806d8b0 0x7fcf681df6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf6e46e640 1 -- 172.21.15.132:0/3254966478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf681d6100 con 0x7fcf6806dcc0 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf6dc6d640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806d3d0 0x7fcf681d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf6e46e640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6806dcc0 0x7fcf68141c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b6fb0 tx=0x7fcf60004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf5e7fc640 1 -- 172.21.15.132:0/3254966478 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60040020 con 0x7fcf6806dcc0 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf5e7fc640 1 -- 172.21.15.132:0/3254966478 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf600077a0 con 0x7fcf6806dcc0 2024-04-25T10:33:19.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681dffa0 con 0x7fcf6806dcc0 2024-04-25T10:33:19.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf5e7fc640 1 -- 172.21.15.132:0/3254966478 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60036040 con 0x7fcf6806dcc0 2024-04-25T10:33:19.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf681d6310 con 0x7fcf6806dcc0 2024-04-25T10:33:19.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf5e7fc640 1 -- 172.21.15.132:0/3254966478 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcf60043020 con 0x7fcf6806dcc0 2024-04-25T10:33:19.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.148+0000 7fcf5e7fc640 1 -- 172.21.15.132:0/3254966478 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fcf6003cae0 con 0x7fcf6806dcc0 2024-04-25T10:33:19.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.149+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf681d57f0 con 0x7fcf6806dcc0 2024-04-25T10:33:19.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.151+0000 7fcf5e7fc640 1 -- 172.21.15.132:0/3254966478 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcf6004a030 con 0x7fcf6806dcc0 2024-04-25T10:33:19.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.223+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9441759-dca9-44cd-b845-a4157edfe094", "id": 1} v 0) -- 0x7fcf6806a130 con 0x7fcf6806dcc0 2024-04-25T10:33:19.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.227+0000 7fcf5e7fc640 1 -- 172.21.15.132:0/3254966478 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9441759-dca9-44cd-b845-a4157edfe094", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fcf60009510 con 0x7fcf6806dcc0 2024-04-25T10:33:19.228 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6806dcc0 msgr2=0x7fcf68141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6806dcc0 0x7fcf68141c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b6fb0 tx=0x7fcf60004a40 comp rx=0 tx=0).stop 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 shutdown_connections 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6806dcc0 0x7fcf68141c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf6806d8b0 0x7fcf681df6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 --2- 172.21.15.132:0/3254966478 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf6806d3d0 0x7fcf681d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 >> 172.21.15.132:0/3254966478 conn(0x7fcf6806c5c0 msgr2=0x7fcf6814d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 shutdown_connections 2024-04-25T10:33:19.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.228+0000 7fcf6fed1640 1 -- 172.21.15.132:0/3254966478 wait complete. 2024-04-25T10:33:19.240 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 5b525cd6-3eda-4001-bff7-ecabf98dbb6a 2 2024-04-25T10:33:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.347+0000 7ff6e9b82640 1 Processor -- start 2024-04-25T10:33:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.347+0000 7ff6e9b82640 1 -- start start 2024-04-25T10:33:19.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e9b82640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6e4149ac0 0x7ff6e40b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e9b82640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e40740f0 0x7ff6e4150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e9b82640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e40b3ae0 con 0x7ff6e40b6f80 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e9b82640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e414a770 con 0x7ff6e4149ac0 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e9b82640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e414a1b0 con 0x7ff6e40740f0 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6e4149ac0 0x7ff6e40b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e40740f0 0x7ff6e4150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6e4149ac0 0x7ff6e40b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37818/0 (socket says 172.21.15.132:37818) 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.348+0000 7ff6e37fe640 1 -- 172.21.15.132:0/2284655327 learned_addr learned my addr 172.21.15.132:0/2284655327 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.349+0000 7ff6e37fe640 1 -- 172.21.15.132:0/2284655327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e40740f0 msgr2=0x7ff6e4150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.349+0000 7ff6e37fe640 1 --2- 172.21.15.132:0/2284655327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e40740f0 0x7ff6e4150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.349+0000 7ff6e37fe640 1 -- 172.21.15.132:0/2284655327 >> v1:172.21.15.103:6789/0 conn(0x7ff6e40b6f80 legacy=0x7ff6e40739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.349+0000 7ff6e37fe640 1 -- 172.21.15.132:0/2284655327 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e414a490 con 0x7ff6e4149ac0 2024-04-25T10:33:19.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.349+0000 7ff6e3fff640 1 --2- 172.21.15.132:0/2284655327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e40740f0 0x7ff6e4150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:19.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.349+0000 7ff6e37fe640 1 --2- 172.21.15.132:0/2284655327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e4149ac0 0x7ff6e40b6a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009870 tx=0x7ff6d402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=449fc753193063fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:19.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e27fc640 1 -- 172.21.15.132:0/2284655327 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4037070 con 0x7ff6e4149ac0 2024-04-25T10:33:19.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e27fc640 1 -- 172.21.15.132:0/2284655327 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4032440 con 0x7ff6e4149ac0 2024-04-25T10:33:19.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e27fc640 1 -- 172.21.15.132:0/2284655327 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4032810 con 0x7ff6e4149ac0 2024-04-25T10:33:19.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2284655327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e4149ac0 msgr2=0x7ff6e40b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e9b82640 1 --2- 172.21.15.132:0/2284655327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e4149ac0 0x7ff6e40b6a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009870 tx=0x7ff6d402a130 comp rx=0 tx=0).stop 2024-04-25T10:33:19.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2284655327 shutdown_connections 2024-04-25T10:33:19.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e9b82640 1 --2- 172.21.15.132:0/2284655327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e40740f0 0x7ff6e4150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e9b82640 1 --2- 172.21.15.132:0/2284655327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e4149ac0 0x7ff6e40b6a40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.350+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2284655327 >> 172.21.15.132:0/2284655327 conn(0x7ff6e406e810 msgr2=0x7ff6e40bb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.351+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2284655327 shutdown_connections 2024-04-25T10:33:19.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.351+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2284655327 wait complete. 2024-04-25T10:33:19.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.352+0000 7ff6e9b82640 1 Processor -- start 2024-04-25T10:33:19.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.352+0000 7ff6e9b82640 1 -- start start 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e9b82640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6e40740f0 0x7ff6e41345f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e9b82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b6f80 0x7ff6e4142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e9b82640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e4149ac0 0x7ff6e4142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e9b82640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40b2560 con 0x7ff6e40740f0 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e9b82640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40b7390 con 0x7ff6e40b6f80 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e9b82640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e40b26e0 con 0x7ff6e4149ac0 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e4149ac0 0x7ff6e4142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b6f80 0x7ff6e4142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b6f80 0x7ff6e4142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37828/0 (socket says 172.21.15.132:37828) 2024-04-25T10:33:19.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e2ffd640 1 -- 172.21.15.132:0/2471271473 learned_addr learned my addr 172.21.15.132:0/2471271473 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.353+0000 7ff6e37fe640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6e40740f0 0x7ff6e41345f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e2ffd640 1 -- 172.21.15.132:0/2471271473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e4149ac0 msgr2=0x7ff6e4142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e2ffd640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e4149ac0 0x7ff6e4142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e2ffd640 1 -- 172.21.15.132:0/2471271473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6e40740f0 msgr2=0x7ff6e41345f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e2ffd640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6e40740f0 0x7ff6e41345f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e2ffd640 1 -- 172.21.15.132:0/2471271473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e41dd490 con 0x7ff6e40b6f80 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e3fff640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e4149ac0 0x7ff6e4142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e2ffd640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b6f80 0x7ff6e4142ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c420 tx=0x7ff6d800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6cbfff640 1 -- 172.21.15.132:0/2471271473 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8017070 con 0x7ff6e40b6f80 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6cbfff640 1 -- 172.21.15.132:0/2471271473 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d80052d0 con 0x7ff6e40b6f80 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6cbfff640 1 -- 172.21.15.132:0/2471271473 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8003830 con 0x7ff6e40b6f80 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e41dd770 con 0x7ff6e40b6f80 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e4140e50 con 0x7ff6e40b6f80 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6cbfff640 1 -- 172.21.15.132:0/2471271473 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff6d801a070 con 0x7ff6e40b6f80 2024-04-25T10:33:19.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.354+0000 7ff6cbfff640 1 -- 172.21.15.132:0/2471271473 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff6d8012420 con 0x7ff6e40b6f80 2024-04-25T10:33:19.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.355+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e406a130 con 0x7ff6e40b6f80 2024-04-25T10:33:19.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.359+0000 7ff6cbfff640 1 -- 172.21.15.132:0/2471271473 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff6d8021070 con 0x7ff6e40b6f80 2024-04-25T10:33:19.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.432+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5b525cd6-3eda-4001-bff7-ecabf98dbb6a", "id": 2} v 0) -- 0x7ff6e4143c50 con 0x7ff6e40b6f80 2024-04-25T10:33:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.436+0000 7ff6cbfff640 1 -- 172.21.15.132:0/2471271473 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b525cd6-3eda-4001-bff7-ecabf98dbb6a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff6d8011d20 con 0x7ff6e40b6f80 2024-04-25T10:33:19.438 INFO:teuthology.orchestra.run.smithi132.stdout:2 2024-04-25T10:33:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b6f80 msgr2=0x7ff6e4142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b6f80 0x7ff6e4142ab0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c420 tx=0x7ff6d800c820 comp rx=0 tx=0).stop 2024-04-25T10:33:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 shutdown_connections 2024-04-25T10:33:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff6e4149ac0 0x7ff6e4142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b6f80 0x7ff6e4142ab0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 --2- 172.21.15.132:0/2471271473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6e40740f0 0x7ff6e41345f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 >> 172.21.15.132:0/2471271473 conn(0x7ff6e406e810 msgr2=0x7ff6e40684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 shutdown_connections 2024-04-25T10:33:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.437+0000 7ff6e9b82640 1 -- 172.21.15.132:0/2471271473 wait complete. 2024-04-25T10:33:19.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 44a1d30b-1c85-496f-a24c-81b95d3b0896 3 2024-04-25T10:33:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.556+0000 7f03c534d640 1 Processor -- start 2024-04-25T10:33:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.557+0000 7f03c534d640 1 -- start start 2024-04-25T10:33:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03c534d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c00743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03c534d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03c0072990 0x7f03c0072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03c534d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03c00b2920 con 0x7f03c00b40c0 2024-04-25T10:33:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03c534d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f03c0146250 con 0x7f03c0072990 2024-04-25T10:33:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03c534d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f03c0146530 con 0x7f03c0073f90 2024-04-25T10:33:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03beffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c00743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03c0072990 0x7f03c0072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03beffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c00743a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33546/0 (socket says 172.21.15.132:33546) 2024-04-25T10:33:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03c0072990 0x7f03c0072da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37840/0 (socket says 172.21.15.132:37840) 2024-04-25T10:33:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03beffd640 1 -- 172.21.15.132:0/968100430 learned_addr learned my addr 172.21.15.132:0/968100430 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03b7fff640 1 -- 172.21.15.132:0/968100430 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 msgr2=0x7f03c00743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03b7fff640 1 --2- 172.21.15.132:0/968100430 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c00743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03b7fff640 1 -- 172.21.15.132:0/968100430 >> v1:172.21.15.103:6789/0 conn(0x7f03c00b40c0 legacy=0x7f03c00b44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03b7fff640 1 -- 172.21.15.132:0/968100430 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c0146810 con 0x7f03c0072990 2024-04-25T10:33:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.558+0000 7f03beffd640 1 --2- 172.21.15.132:0/968100430 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c00743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:19.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.559+0000 7f03b7fff640 1 --2- 172.21.15.132:0/968100430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c0072da0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097d0 tx=0x7f03a802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1ccab09e0b2f695 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.559+0000 7f03be7fc640 1 -- 172.21.15.132:0/968100430 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8037070 con 0x7f03c0072990 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.559+0000 7f03be7fc640 1 -- 172.21.15.132:0/968100430 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a802ae40 con 0x7f03c0072990 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.559+0000 7f03be7fc640 1 -- 172.21.15.132:0/968100430 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8032660 con 0x7f03c0072990 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.560+0000 7f03c534d640 1 -- 172.21.15.132:0/968100430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 msgr2=0x7f03c0072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.560+0000 7f03c534d640 1 --2- 172.21.15.132:0/968100430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c0072da0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03a80097d0 tx=0x7f03a802a130 comp rx=0 tx=0).stop 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.560+0000 7f03c534d640 1 -- 172.21.15.132:0/968100430 shutdown_connections 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.560+0000 7f03c534d640 1 --2- 172.21.15.132:0/968100430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c0072da0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.560+0000 7f03c534d640 1 --2- 172.21.15.132:0/968100430 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c00743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.560+0000 7f03c534d640 1 -- 172.21.15.132:0/968100430 >> 172.21.15.132:0/968100430 conn(0x7f03c00b80d0 msgr2=0x7f03c006ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.560+0000 7f03c534d640 1 -- 172.21.15.132:0/968100430 shutdown_connections 2024-04-25T10:33:19.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.560+0000 7f03c534d640 1 -- 172.21.15.132:0/968100430 wait complete. 2024-04-25T10:33:19.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.562+0000 7f03c534d640 1 Processor -- start 2024-04-25T10:33:19.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.562+0000 7f03c534d640 1 -- start start 2024-04-25T10:33:19.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03c534d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c01417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03c534d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c01db980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03c534d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03c00b40c0 0x7f03c01dec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03c534d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f03c00b5080 con 0x7f03c00b40c0 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03c534d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f03c00b4f00 con 0x7f03c0072990 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03c534d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f03c0145e20 con 0x7f03c0073f90 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03beffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c01417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03b7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c01db980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03beffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c01417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37842/0 (socket says 172.21.15.132:37842) 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03beffd640 1 -- 172.21.15.132:0/1083257377 learned_addr learned my addr 172.21.15.132:0/1083257377 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03bf7fe640 1 --2- 172.21.15.132:0/1083257377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03c00b40c0 0x7f03c01dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03beffd640 1 -- 172.21.15.132:0/1083257377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 msgr2=0x7f03c01db980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03beffd640 1 --2- 172.21.15.132:0/1083257377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c01db980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03beffd640 1 -- 172.21.15.132:0/1083257377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03c00b40c0 msgr2=0x7f03c01dec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03beffd640 1 --2- 172.21.15.132:0/1083257377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03c00b40c0 0x7f03c01dec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.564+0000 7f03beffd640 1 -- 172.21.15.132:0/1083257377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c01dbec0 con 0x7f03c0072990 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.565+0000 7f03beffd640 1 --2- 172.21.15.132:0/1083257377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c01417a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f03b0010c20 tx=0x7f03b000e730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:19.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.565+0000 7f03b77fe640 1 -- 172.21.15.132:0/1083257377 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b001e070 con 0x7f03c0072990 2024-04-25T10:33:19.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.565+0000 7f03b77fe640 1 -- 172.21.15.132:0/1083257377 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b0011650 con 0x7f03c0072990 2024-04-25T10:33:19.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.565+0000 7f03b77fe640 1 -- 172.21.15.132:0/1083257377 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011a00 con 0x7f03c0072990 2024-04-25T10:33:19.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.565+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c01407f0 con 0x7f03c0072990 2024-04-25T10:33:19.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.565+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01d0bb0 con 0x7f03c0072990 2024-04-25T10:33:19.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.565+0000 7f03b77fe640 1 -- 172.21.15.132:0/1083257377 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03b0021070 con 0x7f03c0072990 2024-04-25T10:33:19.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.565+0000 7f03b77fe640 1 -- 172.21.15.132:0/1083257377 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f03b0023dd0 con 0x7f03c0072990 2024-04-25T10:33:19.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.566+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03c006a130 con 0x7f03c0072990 2024-04-25T10:33:19.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.568+0000 7f03b77fe640 1 -- 172.21.15.132:0/1083257377 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f03b0023440 con 0x7f03c0072990 2024-04-25T10:33:19.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.642+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44a1d30b-1c85-496f-a24c-81b95d3b0896", "id": 3} v 0) -- 0x7f03c00b25d0 con 0x7f03c0072990 2024-04-25T10:33:19.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.645+0000 7f03b77fe640 1 -- 172.21.15.132:0/1083257377 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44a1d30b-1c85-496f-a24c-81b95d3b0896", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f03b0011ba0 con 0x7f03c0072990 2024-04-25T10:33:19.647 INFO:teuthology.orchestra.run.smithi132.stdout:3 2024-04-25T10:33:19.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 msgr2=0x7f03c01417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 --2- 172.21.15.132:0/1083257377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c01417a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f03b0010c20 tx=0x7f03b000e730 comp rx=0 tx=0).stop 2024-04-25T10:33:19.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 shutdown_connections 2024-04-25T10:33:19.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 --2- 172.21.15.132:0/1083257377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03c00b40c0 0x7f03c01dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 --2- 172.21.15.132:0/1083257377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f03c0073f90 0x7f03c01db980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 --2- 172.21.15.132:0/1083257377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c0072990 0x7f03c01417a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 >> 172.21.15.132:0/1083257377 conn(0x7f03c00b80d0 msgr2=0x7f03c006ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 shutdown_connections 2024-04-25T10:33:19.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.646+0000 7f03c534d640 1 -- 172.21.15.132:0/1083257377 wait complete. 2024-04-25T10:33:19.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new b5a29201-a715-43c1-8140-819b38808854 4 2024-04-25T10:33:19.681 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:19.678+0000 7fac10419040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T10:33:19.698 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:19.697+0000 7f65d0c10040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T10:33:19.769 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:19.767+0000 7fac10419040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T10:33:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.768+0000 7f9402f06640 1 Processor -- start 2024-04-25T10:33:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.768+0000 7f9402f06640 1 -- start start 2024-04-25T10:33:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f9402f06640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f9402f06640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93fc0b7650 con 0x7f93fc0b2680 2024-04-25T10:33:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f9402f06640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93fc0b5010 con 0x7f93fc0b7b70 2024-04-25T10:33:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f9402f06640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc0b52f0 con 0x7f93fc0b7f80 2024-04-25T10:33:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f93fbfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f93fc0b7b70 0x7f93fc140f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40050/0 (socket says 172.21.15.132:40050) 2024-04-25T10:33:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f93fbfff640 1 -- 172.21.15.132:0/211538705 learned_addr learned my addr 172.21.15.132:0/211538705 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T10:33:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f94014a3640 1 --2- 172.21.15.132:0/211538705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f93fb7fe640 1 -- 172.21.15.132:0/211538705 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774545234 0 0) 0x7f93fc0b5010 con 0x7f93fc0b7b70 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f93fb7fe640 1 -- 172.21.15.132:0/211538705 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93ec003520 con 0x7f93fc0b7b70 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f94014a3640 1 -- 172.21.15.132:0/211538705 >> v1:172.21.15.132:6789/0 conn(0x7f93fc0b7b70 legacy=0x7f93fc140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f94014a3640 1 -- 172.21.15.132:0/211538705 >> v1:172.21.15.103:6789/0 conn(0x7f93fc0b2680 legacy=0x7f93fc073740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f94014a3640 1 -- 172.21.15.132:0/211538705 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc0b55d0 con 0x7f93fc0b7f80 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.769+0000 7f93fb7fe640 1 -- 172.21.15.132:0/211538705 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2730211261 0 0) 0x7f93fc0b7650 con 0x7f93fc0b2680 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.770+0000 7f94014a3640 1 --2- 172.21.15.132:0/211538705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc152bf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009dc0 tx=0x7f93f402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c7f359db53773af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.770+0000 7f93fb7fe640 1 -- 172.21.15.132:0/211538705 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4007740 con 0x7f93fc0b7f80 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.770+0000 7f93fb7fe640 1 -- 172.21.15.132:0/211538705 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f40078e0 con 0x7f93fc0b7f80 2024-04-25T10:33:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.770+0000 7f93fb7fe640 1 -- 172.21.15.132:0/211538705 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4007cb0 con 0x7f93fc0b7f80 2024-04-25T10:33:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.771+0000 7f9402f06640 1 -- 172.21.15.132:0/211538705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 msgr2=0x7f93fc152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.771+0000 7f9402f06640 1 --2- 172.21.15.132:0/211538705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc152bf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009dc0 tx=0x7f93f402a6d0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.771+0000 7f9402f06640 1 -- 172.21.15.132:0/211538705 shutdown_connections 2024-04-25T10:33:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.771+0000 7f9402f06640 1 --2- 172.21.15.132:0/211538705 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc152bf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.771+0000 7f9402f06640 1 -- 172.21.15.132:0/211538705 >> 172.21.15.132:0/211538705 conn(0x7f93fc06e920 msgr2=0x7f93fc0bb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.771+0000 7f9402f06640 1 -- 172.21.15.132:0/211538705 shutdown_connections 2024-04-25T10:33:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.771+0000 7f9402f06640 1 -- 172.21.15.132:0/211538705 wait complete. 2024-04-25T10:33:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.773+0000 7f9402f06640 1 Processor -- start 2024-04-25T10:33:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.773+0000 7f9402f06640 1 -- start start 2024-04-25T10:33:19.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f9402f06640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93fc0b2680 0x7f93fc1442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f9402f06640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0b7b70 0x7f93fc1e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f9402f06640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc13b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f9402f06640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc0729d0 con 0x7f93fc0b2680 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f9402f06640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc074450 con 0x7f93fc0b7b70 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f9402f06640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc143680 con 0x7f93fc0b7f80 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0b7b70 0x7f93fc1e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f94014a3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc13b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0b7b70 0x7f93fc1e08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37858/0 (socket says 172.21.15.132:37858) 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 -- 172.21.15.132:0/2457128859 learned_addr learned my addr 172.21.15.132:0/2457128859 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f94014a3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc13b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33566/0 (socket says 172.21.15.132:33566) 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f9400ca2640 1 --2- 172.21.15.132:0/2457128859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93fc0b2680 0x7f93fc1442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 -- 172.21.15.132:0/2457128859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 msgr2=0x7f93fc13b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 --2- 172.21.15.132:0/2457128859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc13b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 -- 172.21.15.132:0/2457128859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93fc0b2680 msgr2=0x7f93fc1442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 --2- 172.21.15.132:0/2457128859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93fc0b2680 0x7f93fc1442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 -- 172.21.15.132:0/2457128859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc1e0e30 con 0x7f93fc0b7b70 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.774+0000 7f93fbfff640 1 --2- 172.21.15.132:0/2457128859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0b7b70 0x7f93fc1e08f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93e800c3c0 tx=0x7f93e800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.775+0000 7f93f97fa640 1 -- 172.21.15.132:0/2457128859 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8017070 con 0x7f93fc0b7b70 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.775+0000 7f93f97fa640 1 -- 172.21.15.132:0/2457128859 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e8005d00 con 0x7f93fc0b7b70 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.775+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc143820 con 0x7f93fc0b7b70 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.775+0000 7f93f97fa640 1 -- 172.21.15.132:0/2457128859 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8007310 con 0x7f93fc0b7b70 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.775+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc1433a0 con 0x7f93fc0b7b70 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.775+0000 7f93f97fa640 1 -- 172.21.15.132:0/2457128859 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f93e801a070 con 0x7f93fc0b7b70 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.775+0000 7f93f97fa640 1 -- 172.21.15.132:0/2457128859 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f93e8012910 con 0x7f93fc0b7b70 2024-04-25T10:33:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.776+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93fc06a130 con 0x7f93fc0b7b70 2024-04-25T10:33:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.778+0000 7f93f97fa640 1 -- 172.21.15.132:0/2457128859 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f93e8021070 con 0x7f93fc0b7b70 2024-04-25T10:33:19.792 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:19.790+0000 7f65d0c10040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T10:33:19.813 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:19.811+0000 7fac10419040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T10:33:19.836 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:19.834+0000 7f65d0c10040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T10:33:19.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.850+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5a29201-a715-43c1-8140-819b38808854", "id": 4} v 0) -- 0x7f93fc1e0550 con 0x7f93fc0b7b70 2024-04-25T10:33:19.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.856+0000 7f93f97fa640 1 -- 172.21.15.132:0/2457128859 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5a29201-a715-43c1-8140-819b38808854", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f93e8012d80 con 0x7f93fc0b7b70 2024-04-25T10:33:19.858 INFO:teuthology.orchestra.run.smithi132.stdout:4 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0b7b70 msgr2=0x7f93fc1e08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 --2- 172.21.15.132:0/2457128859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0b7b70 0x7f93fc1e08f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93e800c3c0 tx=0x7f93e800c880 comp rx=0 tx=0).stop 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 shutdown_connections 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 --2- 172.21.15.132:0/2457128859 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f93fc0b7f80 0x7f93fc13b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 --2- 172.21.15.132:0/2457128859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93fc0b7b70 0x7f93fc1e08f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 --2- 172.21.15.132:0/2457128859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93fc0b2680 0x7f93fc1442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 >> 172.21.15.132:0/2457128859 conn(0x7f93fc06e920 msgr2=0x7f93fc140e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 shutdown_connections 2024-04-25T10:33:19.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:19.857+0000 7f9402f06640 1 -- 172.21.15.132:0/2457128859 wait complete. 2024-04-25T10:33:19.869 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 1be71253-ff24-4977-bfcf-b54d40e26d56 5 2024-04-25T10:33:19.981 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:19.978+0000 7fac10419040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T10:33:20.010 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:20.009+0000 7f65d0c10040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T10:33:20.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.016+0000 7efcaf467640 1 Processor -- start 2024-04-25T10:33:20.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.016+0000 7efcaf467640 1 -- start start 2024-04-25T10:33:20.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcaf467640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80739b0 0x7efca8073020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcaf467640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efca8141900 0x7efca8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcaf467640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca8073dc0 con 0x7efca80b5110 2024-04-25T10:33:20.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcaf467640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7efca80b2a40 con 0x7efca8141900 2024-04-25T10:33:20.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcaf467640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7efca80740b0 con 0x7efca80739b0 2024-04-25T10:33:20.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcad203640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80739b0 0x7efca8073020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcad203640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80739b0 0x7efca8073020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33576/0 (socket says 172.21.15.132:33576) 2024-04-25T10:33:20.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcaca02640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efca80b5110 0x7efca81411f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.132:40914/0 (socket says 172.21.15.132:40914) 2024-04-25T10:33:20.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcad203640 1 -- 172.21.15.132:0/3810560211 learned_addr learned my addr 172.21.15.132:0/3810560211 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:20.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcada04640 1 --2- 172.21.15.132:0/3810560211 >> v2:172.21.15.103:3300/0 conn(0x7efca8141900 0x7efca8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.017+0000 7efcad203640 1 -- 172.21.15.132:0/3810560211 >> v2:172.21.15.103:3300/0 conn(0x7efca8141900 msgr2=0x7efca8151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:20.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.018+0000 7efcad203640 1 --2- 172.21.15.132:0/3810560211 >> v2:172.21.15.103:3300/0 conn(0x7efca8141900 0x7efca8151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.018+0000 7efcad203640 1 -- 172.21.15.132:0/3810560211 >> v1:172.21.15.103:6789/0 conn(0x7efca80b5110 legacy=0x7efca81411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.018+0000 7efcad203640 1 -- 172.21.15.132:0/3810560211 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca8072b60 con 0x7efca80739b0 2024-04-25T10:33:20.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.018+0000 7efcad203640 1 --2- 172.21.15.132:0/3810560211 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80739b0 0x7efca8073020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeeb39b86e8ad972 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:20.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.018+0000 7efc9ffff640 1 -- 172.21.15.132:0/3810560211 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4037070 con 0x7efca80739b0 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.018+0000 7efc9ffff640 1 -- 172.21.15.132:0/3810560211 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca4032440 con 0x7efca80739b0 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.018+0000 7efc9ffff640 1 -- 172.21.15.132:0/3810560211 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca4032810 con 0x7efca80739b0 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.019+0000 7efcaf467640 1 -- 172.21.15.132:0/3810560211 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80739b0 msgr2=0x7efca8073020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.019+0000 7efcaf467640 1 --2- 172.21.15.132:0/3810560211 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80739b0 0x7efca8073020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efca4009870 tx=0x7efca402a270 comp rx=0 tx=0).stop 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.019+0000 7efcaf467640 1 -- 172.21.15.132:0/3810560211 shutdown_connections 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.019+0000 7efcaf467640 1 --2- 172.21.15.132:0/3810560211 >> v2:172.21.15.103:3300/0 conn(0x7efca8141900 0x7efca8151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.019+0000 7efcaf467640 1 --2- 172.21.15.132:0/3810560211 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80739b0 0x7efca8073020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.019+0000 7efcaf467640 1 -- 172.21.15.132:0/3810560211 >> 172.21.15.132:0/3810560211 conn(0x7efca806e920 msgr2=0x7efca80bb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.019+0000 7efcaf467640 1 -- 172.21.15.132:0/3810560211 shutdown_connections 2024-04-25T10:33:20.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.019+0000 7efcaf467640 1 -- 172.21.15.132:0/3810560211 wait complete. 2024-04-25T10:33:20.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.021+0000 7efcaf467640 1 Processor -- start 2024-04-25T10:33:20.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.021+0000 7efcaf467640 1 -- start start 2024-04-25T10:33:20.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaf467640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efca80739b0 0x7efca81e3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaf467640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80b5110 0x7efca8142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaf467640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efca8141900 0x7efca813c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaf467640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efca80b2770 con 0x7efca80739b0 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaf467640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efca80b25f0 con 0x7efca8141900 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaf467640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7efca80b5520 con 0x7efca80b5110 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaca02640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80b5110 0x7efca8142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcada04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efca8141900 0x7efca813c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaca02640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80b5110 0x7efca8142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33588/0 (socket says 172.21.15.132:33588) 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcada04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efca8141900 0x7efca813c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37870/0 (socket says 172.21.15.132:37870) 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaca02640 1 -- 172.21.15.132:0/4051321625 learned_addr learned my addr 172.21.15.132:0/4051321625 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcad203640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efca80739b0 0x7efca81e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaca02640 1 -- 172.21.15.132:0/4051321625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efca8141900 msgr2=0x7efca813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaca02640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efca8141900 0x7efca813c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaca02640 1 -- 172.21.15.132:0/4051321625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efca80739b0 msgr2=0x7efca81e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaca02640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efca80739b0 0x7efca81e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcaca02640 1 -- 172.21.15.132:0/4051321625 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca813f0a0 con 0x7efca80b5110 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcada04640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efca8141900 0x7efca813c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.022+0000 7efcad203640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efca80739b0 0x7efca81e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.023+0000 7efcaca02640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80b5110 0x7efca8142180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c440 tx=0x7efc9800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.023+0000 7efc9dffb640 1 -- 172.21.15.132:0/4051321625 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc980074e0 con 0x7efca80b5110 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.023+0000 7efc9dffb640 1 -- 172.21.15.132:0/4051321625 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc98007680 con 0x7efca80b5110 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.023+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca81e3e90 con 0x7efca80b5110 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.023+0000 7efc9dffb640 1 -- 172.21.15.132:0/4051321625 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc98004a20 con 0x7efca80b5110 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.023+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efca81426c0 con 0x7efca80b5110 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.023+0000 7efc9dffb640 1 -- 172.21.15.132:0/4051321625 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc9801a020 con 0x7efca80b5110 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.023+0000 7efc9dffb640 1 -- 172.21.15.132:0/4051321625 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7efc98012bd0 con 0x7efca80b5110 2024-04-25T10:33:20.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.024+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca806a130 con 0x7efca80b5110 2024-04-25T10:33:20.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.026+0000 7efc9dffb640 1 -- 172.21.15.132:0/4051321625 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7efc98021070 con 0x7efca80b5110 2024-04-25T10:33:20.029 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:20.026+0000 7fac10419040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T10:33:20.061 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:20.059+0000 7f65d0c10040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T10:33:20.082 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:20.079+0000 7fac10419040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T10:33:20.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.099+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1be71253-ff24-4977-bfcf-b54d40e26d56", "id": 5} v 0) -- 0x7efca80b6300 con 0x7efca80b5110 2024-04-25T10:33:20.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.104+0000 7efc9dffb640 1 -- 172.21.15.132:0/4051321625 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1be71253-ff24-4977-bfcf-b54d40e26d56", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7efca8073dc0 con 0x7efca80b5110 2024-04-25T10:33:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:5 2024-04-25T10:33:20.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80b5110 msgr2=0x7efca8142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80b5110 0x7efca8142180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c440 tx=0x7efc9800c900 comp rx=0 tx=0).stop 2024-04-25T10:33:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 shutdown_connections 2024-04-25T10:33:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efca8141900 0x7efca813c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efca80b5110 0x7efca8142180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 --2- 172.21.15.132:0/4051321625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efca80739b0 0x7efca81e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 >> 172.21.15.132:0/4051321625 conn(0x7efca806e920 msgr2=0x7efca8146ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 shutdown_connections 2024-04-25T10:33:20.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.105+0000 7efcaf467640 1 -- 172.21.15.132:0/4051321625 wait complete. 2024-04-25T10:33:20.116 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:20.114+0000 7f65d0c10040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T10:33:20.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new cb795768-9a09-4342-8274-24d649929024 6 2024-04-25T10:33:20.196 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:20.194+0000 7fac10419040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:33:20.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.223+0000 7f3a33aa7640 1 Processor -- start 2024-04-25T10:33:20.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.224+0000 7f3a33aa7640 1 -- start start 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a33aa7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a33aa7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3a2c0b5460 0x7f3a2c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a33aa7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a2c146380 0x7f3a2c146790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a33aa7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2c0b2560 con 0x7f3a2c0b5460 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a33aa7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2c0b2840 con 0x7f3a2c146380 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a33aa7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c146cd0 con 0x7f3a2c0b2d20 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a32044640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a2c146380 0x7f3a2c146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a31843640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a32044640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a2c146380 0x7f3a2c146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37876/0 (socket says 172.21.15.132:37876) 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a31843640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c0b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33602/0 (socket says 172.21.15.132:33602) 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a32044640 1 -- 172.21.15.132:0/2435467913 learned_addr learned my addr 172.21.15.132:0/2435467913 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a31042640 1 --2- 172.21.15.132:0/2435467913 >> v2:172.21.15.103:3300/0 conn(0x7f3a2c0b5460 0x7f3a2c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a31843640 1 -- 172.21.15.132:0/2435467913 >> v2:172.21.15.132:3300/0 conn(0x7f3a2c146380 msgr2=0x7f3a2c146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a31843640 1 --2- 172.21.15.132:0/2435467913 >> v2:172.21.15.132:3300/0 conn(0x7f3a2c146380 0x7f3a2c146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a31843640 1 -- 172.21.15.132:0/2435467913 >> v2:172.21.15.103:3300/0 conn(0x7f3a2c0b5460 msgr2=0x7f3a2c0b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a31843640 1 --2- 172.21.15.132:0/2435467913 >> v2:172.21.15.103:3300/0 conn(0x7f3a2c0b5460 0x7f3a2c0b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a31843640 1 -- 172.21.15.132:0/2435467913 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c0b7360 con 0x7f3a2c0b2d20 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.225+0000 7f3a32044640 1 --2- 172.21.15.132:0/2435467913 >> v2:172.21.15.132:3300/0 conn(0x7f3a2c146380 0x7f3a2c146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.226+0000 7f3a31843640 1 --2- 172.21.15.132:0/2435467913 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c0b6760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0721f0 tx=0x7f3a1c02a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebaeda0d9a23b44a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.226+0000 7f3a30841640 1 -- 172.21.15.132:0/2435467913 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c037070 con 0x7f3a2c0b2d20 2024-04-25T10:33:20.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.226+0000 7f3a30841640 1 -- 172.21.15.132:0/2435467913 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c02ad50 con 0x7f3a2c0b2d20 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.226+0000 7f3a30841640 1 -- 172.21.15.132:0/2435467913 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c032660 con 0x7f3a2c0b2d20 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 -- 172.21.15.132:0/2435467913 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 msgr2=0x7f3a2c0b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 --2- 172.21.15.132:0/2435467913 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c0b6760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c0721f0 tx=0x7f3a1c02a000 comp rx=0 tx=0).stop 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 -- 172.21.15.132:0/2435467913 shutdown_connections 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 --2- 172.21.15.132:0/2435467913 >> v2:172.21.15.132:3300/0 conn(0x7f3a2c146380 0x7f3a2c146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 --2- 172.21.15.132:0/2435467913 >> v2:172.21.15.103:3300/0 conn(0x7f3a2c0b5460 0x7f3a2c0b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 --2- 172.21.15.132:0/2435467913 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c0b6760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 -- 172.21.15.132:0/2435467913 >> 172.21.15.132:0/2435467913 conn(0x7f3a2c06e0c0 msgr2=0x7f3a2c0bb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 -- 172.21.15.132:0/2435467913 shutdown_connections 2024-04-25T10:33:20.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.227+0000 7f3a33aa7640 1 -- 172.21.15.132:0/2435467913 wait complete. 2024-04-25T10:33:20.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.228+0000 7f3a33aa7640 1 Processor -- start 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.229+0000 7f3a33aa7640 1 -- start start 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.229+0000 7f3a33aa7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c1df610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.229+0000 7f3a33aa7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a2c0b5460 0x7f3a2c1dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.229+0000 7f3a33aa7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a2c146380 0x7f3a2c1e2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.229+0000 7f3a33aa7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c149770 con 0x7f3a2c0b5460 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.229+0000 7f3a33aa7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c0b71a0 con 0x7f3a2c146380 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.229+0000 7f3a33aa7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2c1498f0 con 0x7f3a2c0b2d20 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a31843640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c1df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a32044640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a2c146380 0x7f3a2c1e2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a31843640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c1df610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:33618/0 (socket says 172.21.15.132:33618) 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a31843640 1 -- 172.21.15.132:0/1736869528 learned_addr learned my addr 172.21.15.132:0/1736869528 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a31042640 1 --2- 172.21.15.132:0/1736869528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a2c0b5460 0x7f3a2c1dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a32044640 1 -- 172.21.15.132:0/1736869528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 msgr2=0x7f3a2c1df610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a32044640 1 --2- 172.21.15.132:0/1736869528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c1df610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a32044640 1 -- 172.21.15.132:0/1736869528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a2c0b5460 msgr2=0x7f3a2c1dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a32044640 1 --2- 172.21.15.132:0/1736869528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a2c0b5460 0x7f3a2c1dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a32044640 1 -- 172.21.15.132:0/1736869528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c1e02d0 con 0x7f3a2c146380 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a32044640 1 --2- 172.21.15.132:0/1736869528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a2c146380 0x7f3a2c1e2970 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400efc0 tx=0x7f3a2400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a227fc640 1 -- 172.21.15.132:0/1736869528 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2400cb20 con 0x7f3a2c146380 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a227fc640 1 -- 172.21.15.132:0/1736869528 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2400cce0 con 0x7f3a2c146380 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c1503c0 con 0x7f3a2c146380 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a227fc640 1 -- 172.21.15.132:0/1736869528 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24003bd0 con 0x7f3a2c146380 2024-04-25T10:33:20.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c14f870 con 0x7f3a2c146380 2024-04-25T10:33:20.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a227fc640 1 -- 172.21.15.132:0/1736869528 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a2401b030 con 0x7f3a2c146380 2024-04-25T10:33:20.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.230+0000 7f3a227fc640 1 -- 172.21.15.132:0/1736869528 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3a2401dbe0 con 0x7f3a2c146380 2024-04-25T10:33:20.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.231+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2c143cc0 con 0x7f3a2c146380 2024-04-25T10:33:20.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.233+0000 7f3a227fc640 1 -- 172.21.15.132:0/1736869528 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3a24022020 con 0x7f3a2c146380 2024-04-25T10:33:20.237 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:20.235+0000 7f65d0c10040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:33:20.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.306+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb795768-9a09-4342-8274-24d649929024", "id": 6} v 0) -- 0x7f3a2c1dfb50 con 0x7f3a2c146380 2024-04-25T10:33:20.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.311+0000 7f3a227fc640 1 -- 172.21.15.132:0/1736869528 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb795768-9a09-4342-8274-24d649929024", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3a24010040 con 0x7f3a2c146380 2024-04-25T10:33:20.314 INFO:teuthology.orchestra.run.smithi132.stdout:6 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.312+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a2c146380 msgr2=0x7f3a2c1e2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.312+0000 7f3a33aa7640 1 --2- 172.21.15.132:0/1736869528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a2c146380 0x7f3a2c1e2970 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400efc0 tx=0x7f3a2400c490 comp rx=0 tx=0).stop 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.313+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 shutdown_connections 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.313+0000 7f3a33aa7640 1 --2- 172.21.15.132:0/1736869528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a2c146380 0x7f3a2c1e2970 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.313+0000 7f3a33aa7640 1 --2- 172.21.15.132:0/1736869528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a2c0b5460 0x7f3a2c1dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.313+0000 7f3a33aa7640 1 --2- 172.21.15.132:0/1736869528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a2c0b2d20 0x7f3a2c1df610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.313+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 >> 172.21.15.132:0/1736869528 conn(0x7f3a2c06e0c0 msgr2=0x7f3a2c1440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.313+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 shutdown_connections 2024-04-25T10:33:20.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.313+0000 7f3a33aa7640 1 -- 172.21.15.132:0/1736869528 wait complete. 2024-04-25T10:33:20.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 9ad4b365-afdd-4687-ba16-140d6796a02d 7 2024-04-25T10:33:20.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.436+0000 7f5bba405640 1 Processor -- start 2024-04-25T10:33:20.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.436+0000 7f5bba405640 1 -- start start 2024-04-25T10:33:20.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bba405640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5bb40b2670 0x7f5bb41436e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bba405640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5bb40b6300 0x7f5bb406ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bba405640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bb40b6b20 con 0x7f5bb414caa0 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bba405640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb40b7170 con 0x7f5bb40b6300 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bba405640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb40b6e00 con 0x7f5bb40b2670 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bb3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5bb40b2670 0x7f5bb41436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bb3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5bb40b2670 0x7f5bb41436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37894/0 (socket says 172.21.15.132:37894) 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bb3fff640 1 -- 172.21.15.132:0/4146472793 learned_addr learned my addr 172.21.15.132:0/4146472793 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bb37fe640 1 --2- 172.21.15.132:0/4146472793 >> v2:172.21.15.103:3300/0 conn(0x7f5bb40b6300 0x7f5bb406ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bb3fff640 1 -- 172.21.15.132:0/4146472793 >> v2:172.21.15.103:3300/0 conn(0x7f5bb40b6300 msgr2=0x7f5bb406ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bb3fff640 1 --2- 172.21.15.132:0/4146472793 >> v2:172.21.15.103:3300/0 conn(0x7f5bb40b6300 0x7f5bb406ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bb3fff640 1 -- 172.21.15.132:0/4146472793 >> v1:172.21.15.103:6789/0 conn(0x7f5bb414caa0 legacy=0x7f5bb4149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.437+0000 7f5bb3fff640 1 -- 172.21.15.132:0/4146472793 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb4143c20 con 0x7f5bb40b2670 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.438+0000 7f5bb3fff640 1 --2- 172.21.15.132:0/4146472793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb41436e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40b8360 tx=0x7f5ba402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41e53109545911ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.438+0000 7f5bb2ffd640 1 -- 172.21.15.132:0/4146472793 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4037070 con 0x7f5bb40b2670 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.438+0000 7f5bb2ffd640 1 -- 172.21.15.132:0/4146472793 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4032440 con 0x7f5bb40b2670 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.438+0000 7f5bb2ffd640 1 -- 172.21.15.132:0/4146472793 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4032810 con 0x7f5bb40b2670 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.439+0000 7f5bba405640 1 -- 172.21.15.132:0/4146472793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 msgr2=0x7f5bb41436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.439+0000 7f5bba405640 1 --2- 172.21.15.132:0/4146472793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb41436e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40b8360 tx=0x7f5ba402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.439+0000 7f5bba405640 1 -- 172.21.15.132:0/4146472793 shutdown_connections 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.439+0000 7f5bba405640 1 --2- 172.21.15.132:0/4146472793 >> v2:172.21.15.103:3300/0 conn(0x7f5bb40b6300 0x7f5bb406ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.439+0000 7f5bba405640 1 --2- 172.21.15.132:0/4146472793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb41436e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.439+0000 7f5bba405640 1 -- 172.21.15.132:0/4146472793 >> 172.21.15.132:0/4146472793 conn(0x7f5bb406e920 msgr2=0x7f5bb40bb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.439+0000 7f5bba405640 1 -- 172.21.15.132:0/4146472793 shutdown_connections 2024-04-25T10:33:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.439+0000 7f5bba405640 1 -- 172.21.15.132:0/4146472793 wait complete. 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.441+0000 7f5bba405640 1 Processor -- start 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.441+0000 7f5bba405640 1 -- start start 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bba405640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb413f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bba405640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5bb40b6300 0x7f5bb4149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bba405640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb414caa0 0x7f5bb413c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bba405640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4074570 con 0x7f5bb414caa0 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bba405640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40743f0 con 0x7f5bb40b2670 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bba405640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb406d390 con 0x7f5bb40b6300 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb413f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb413f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37908/0 (socket says 172.21.15.132:37908) 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb37fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5bb40b6300 0x7f5bb4149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 -- 172.21.15.132:0/1514583773 learned_addr learned my addr 172.21.15.132:0/1514583773 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb89a2640 1 --2- 172.21.15.132:0/1514583773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb414caa0 0x7f5bb413c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 -- 172.21.15.132:0/1514583773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5bb40b6300 msgr2=0x7f5bb4149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 --2- 172.21.15.132:0/1514583773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5bb40b6300 0x7f5bb4149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 -- 172.21.15.132:0/1514583773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb414caa0 msgr2=0x7f5bb413c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 --2- 172.21.15.132:0/1514583773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb414caa0 0x7f5bb413c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 -- 172.21.15.132:0/1514583773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb413f690 con 0x7f5bb40b2670 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb3fff640 1 --2- 172.21.15.132:0/1514583773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb413f150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5ba402a220 tx=0x7f5ba40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb0ff9640 1 -- 172.21.15.132:0/1514583773 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4037040 con 0x7f5bb40b2670 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb0ff9640 1 -- 172.21.15.132:0/1514583773 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4042070 con 0x7f5bb40b2670 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb41486d0 con 0x7f5bb40b2670 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.442+0000 7f5bb0ff9640 1 -- 172.21.15.132:0/1514583773 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4030880 con 0x7f5bb40b2670 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.443+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb4148c90 con 0x7f5bb40b2670 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.443+0000 7f5bb0ff9640 1 -- 172.21.15.132:0/1514583773 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ba4030a20 con 0x7f5bb40b2670 2024-04-25T10:33:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.443+0000 7f5bb0ff9640 1 -- 172.21.15.132:0/1514583773 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f5ba4047b40 con 0x7f5bb40b2670 2024-04-25T10:33:20.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.443+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb406a130 con 0x7f5bb40b2670 2024-04-25T10:33:20.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.446+0000 7f5bb0ff9640 1 -- 172.21.15.132:0/1514583773 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5ba4047460 con 0x7f5bb40b2670 2024-04-25T10:33:20.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.518+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ad4b365-afdd-4687-ba16-140d6796a02d", "id": 7} v 0) -- 0x7f5bb413ee20 con 0x7f5bb40b2670 2024-04-25T10:33:20.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.527+0000 7f5bb0ff9640 1 -- 172.21.15.132:0/1514583773 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ad4b365-afdd-4687-ba16-140d6796a02d", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f5ba4047640 con 0x7f5bb40b2670 2024-04-25T10:33:20.528 INFO:teuthology.orchestra.run.smithi132.stdout:7 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 msgr2=0x7f5bb413f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 --2- 172.21.15.132:0/1514583773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb413f150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5ba402a220 tx=0x7f5ba40046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 shutdown_connections 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 --2- 172.21.15.132:0/1514583773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb414caa0 0x7f5bb413c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 --2- 172.21.15.132:0/1514583773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5bb40b6300 0x7f5bb4149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 --2- 172.21.15.132:0/1514583773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bb40b2670 0x7f5bb413f150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 >> 172.21.15.132:0/1514583773 conn(0x7f5bb406e920 msgr2=0x7f5bb4075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 shutdown_connections 2024-04-25T10:33:20.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T10:33:20.528+0000 7f5bba405640 1 -- 172.21.15.132:0/1514583773 wait complete. 2024-04-25T10:33:20.540 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T10:33:20.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T10:33:20.542 INFO:tasks.ceph.osd.0:Started 2024-04-25T10:33:20.542 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T10:33:20.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T10:33:20.545 INFO:tasks.ceph.osd.1:Started 2024-04-25T10:33:20.545 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T10:33:20.545 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T10:33:20.547 INFO:tasks.ceph.osd.2:Started 2024-04-25T10:33:20.547 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T10:33:20.547 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T10:33:20.549 INFO:tasks.ceph.osd.3:Started 2024-04-25T10:33:20.549 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T10:33:20.549 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T10:33:20.551 INFO:tasks.ceph.osd.4:Started 2024-04-25T10:33:20.552 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T10:33:20.552 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T10:33:20.554 INFO:tasks.ceph.osd.5:Started 2024-04-25T10:33:20.554 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T10:33:20.554 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T10:33:20.556 INFO:tasks.ceph.osd.6:Started 2024-04-25T10:33:20.556 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T10:33:20.556 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T10:33:20.558 INFO:tasks.ceph.osd.7:Started 2024-04-25T10:33:20.558 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:20.609 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:20.606+0000 7fac10419040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T10:33:20.678 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:20.677+0000 7f65d0c10040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T10:33:20.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.679+0000 7ff03e00c640 1 Processor -- start 2024-04-25T10:33:20.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.679+0000 7ff03e00c640 1 -- start start 2024-04-25T10:33:20.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff03e00c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0380b5080 0x7ff03806c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff03e00c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff03814d4d0 0x7ff038149e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff03e00c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0381496a0 con 0x7ff03814a3c0 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff03e00c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff0381499f0 con 0x7ff0380b5080 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff03e00c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff03806e040 con 0x7ff03814d4d0 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff0377fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0380b5080 0x7ff03806c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff037fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff03814a3c0 0x7ff038072a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57890/0 (socket says 172.21.15.103:57890) 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff0377fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0380b5080 0x7ff03806c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34730/0 (socket says 172.21.15.103:34730) 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff037fff640 1 -- 172.21.15.103:0/1911924259 learned_addr learned my addr 172.21.15.103:0/1911924259 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff036ffd640 1 --2- 172.21.15.103:0/1911924259 >> v2:172.21.15.132:3300/0 conn(0x7ff03814d4d0 0x7ff038149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff0377fe640 1 -- 172.21.15.103:0/1911924259 >> v2:172.21.15.132:3300/0 conn(0x7ff03814d4d0 msgr2=0x7ff038149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff0377fe640 1 --2- 172.21.15.103:0/1911924259 >> v2:172.21.15.132:3300/0 conn(0x7ff03814d4d0 0x7ff038149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff0377fe640 1 -- 172.21.15.103:0/1911924259 >> v1:172.21.15.103:6789/0 conn(0x7ff03814a3c0 legacy=0x7ff038072a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.680+0000 7ff0377fe640 1 -- 172.21.15.103:0/1911924259 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff038072380 con 0x7ff0380b5080 2024-04-25T10:33:20.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.681+0000 7ff0377fe640 1 --2- 172.21.15.103:0/1911924259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff03806c860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff038149b70 tx=0x7ff02802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bdfab48c378ad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:20.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.681+0000 7ff0367fc640 1 -- 172.21.15.103:0/1911924259 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028037070 con 0x7ff0380b5080 2024-04-25T10:33:20.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.681+0000 7ff0367fc640 1 -- 172.21.15.103:0/1911924259 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028032440 con 0x7ff0380b5080 2024-04-25T10:33:20.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.681+0000 7ff0367fc640 1 -- 172.21.15.103:0/1911924259 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028032810 con 0x7ff0380b5080 2024-04-25T10:33:20.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.682+0000 7ff03e00c640 1 -- 172.21.15.103:0/1911924259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 msgr2=0x7ff03806c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.682+0000 7ff03e00c640 1 --2- 172.21.15.103:0/1911924259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff03806c860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff038149b70 tx=0x7ff02802a1a0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.682+0000 7ff03e00c640 1 -- 172.21.15.103:0/1911924259 shutdown_connections 2024-04-25T10:33:20.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.682+0000 7ff03e00c640 1 --2- 172.21.15.103:0/1911924259 >> v2:172.21.15.132:3300/0 conn(0x7ff03814d4d0 0x7ff038149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.682+0000 7ff03e00c640 1 --2- 172.21.15.103:0/1911924259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff03806c860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.682+0000 7ff03e00c640 1 -- 172.21.15.103:0/1911924259 >> 172.21.15.103:0/1911924259 conn(0x7ff03806ce50 msgr2=0x7ff03806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:20.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.682+0000 7ff03e00c640 1 -- 172.21.15.103:0/1911924259 shutdown_connections 2024-04-25T10:33:20.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.682+0000 7ff03e00c640 1 -- 172.21.15.103:0/1911924259 wait complete. 2024-04-25T10:33:20.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.683+0000 7ff03e00c640 1 Processor -- start 2024-04-25T10:33:20.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.684+0000 7ff03e00c640 1 -- start start 2024-04-25T10:33:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff03e00c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff0380b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff03e00c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff03814a3c0 0x7ff0381df680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff03e00c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff03814d4d0 0x7ff03813e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff03e00c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff038071ef0 con 0x7ff0380b5080 2024-04-25T10:33:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff03e00c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff038143cb0 con 0x7ff03814d4d0 2024-04-25T10:33:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff03e00c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff038072070 con 0x7ff03814a3c0 2024-04-25T10:33:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff0380b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff0380b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34738/0 (socket says 172.21.15.103:34738) 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 -- 172.21.15.103:0/3103023473 learned_addr learned my addr 172.21.15.103:0/3103023473 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff037fff640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff03814d4d0 0x7ff03813e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff036ffd640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff03814a3c0 0x7ff0381df680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 -- 172.21.15.103:0/3103023473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff03814a3c0 msgr2=0x7ff0381df680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff03814a3c0 0x7ff0381df680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 -- 172.21.15.103:0/3103023473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff03814d4d0 msgr2=0x7ff03813e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff03814d4d0 0x7ff03813e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 -- 172.21.15.103:0/3103023473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0381d3c20 con 0x7ff0380b5080 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff0377fe640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff0380b3980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff028009860 tx=0x7ff0280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff01ffff640 1 -- 172.21.15.103:0/3103023473 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028037040 con 0x7ff0380b5080 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff01ffff640 1 -- 172.21.15.103:0/3103023473 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff028042070 con 0x7ff0380b5080 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff01ffff640 1 -- 172.21.15.103:0/3103023473 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028030960 con 0x7ff0380b5080 2024-04-25T10:33:20.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.685+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0381dfbc0 con 0x7ff0380b5080 2024-04-25T10:33:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.686+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0381d3170 con 0x7ff0380b5080 2024-04-25T10:33:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.686+0000 7ff01ffff640 1 -- 172.21.15.103:0/3103023473 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff028030b00 con 0x7ff0380b5080 2024-04-25T10:33:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.686+0000 7ff01ffff640 1 -- 172.21.15.103:0/3103023473 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff028047c30 con 0x7ff0380b5080 2024-04-25T10:33:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.687+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03806d5e0 con 0x7ff0380b5080 2024-04-25T10:33:20.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.689+0000 7ff01ffff640 1 -- 172.21.15.103:0/3103023473 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff028047460 con 0x7ff0380b5080 2024-04-25T10:33:20.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.749+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0381df250 con 0x7ff0380b5080 2024-04-25T10:33:20.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.749+0000 7ff01ffff640 1 -- 172.21.15.103:0/3103023473 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff028047640 con 0x7ff0380b5080 2024-04-25T10:33:20.752 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:20.752 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":10,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:20.520610+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:20.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 msgr2=0x7ff0380b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:20.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff0380b3980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff028009860 tx=0x7ff0280046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 shutdown_connections 2024-04-25T10:33:20.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff03814d4d0 0x7ff03813e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff03814a3c0 0x7ff0381df680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 --2- 172.21.15.103:0/3103023473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0380b5080 0x7ff0380b3980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:20.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 >> 172.21.15.103:0/3103023473 conn(0x7ff03806ce50 msgr2=0x7ff0380b9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:20.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 shutdown_connections 2024-04-25T10:33:20.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:20.750+0000 7ff03e00c640 1 -- 172.21.15.103:0/3103023473 wait complete. 2024-04-25T10:33:20.764 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T10:33:20.764 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T10:33:20.902 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:20.900+0000 7fac10419040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T10:33:20.936 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:20.934+0000 7f65d0c10040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T10:33:20.956 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:20.954+0000 7fac10419040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T10:33:20.988 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:20.987+0000 7f65d0c10040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T10:33:21.074 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:21.072+0000 7fac10419040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T10:33:21.105 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:21.104+0000 7f65d0c10040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T10:33:21.177 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-04-25T10:33:21.175+0000 7f3bbd52c640 -1 Falling back to public interface 2024-04-25T10:33:21.178 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-04-25T10:33:21.175+0000 7f4c18568640 -1 Falling back to public interface 2024-04-25T10:33:21.178 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-04-25T10:33:21.177+0000 7f75546e1640 -1 Falling back to public interface 2024-04-25T10:33:21.181 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-04-25T10:33:21.179+0000 7f3300ddc640 -1 Falling back to public interface 2024-04-25T10:33:21.181 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-04-25T10:33:21.178+0000 7fbf78501640 -1 Falling back to public interface 2024-04-25T10:33:21.188 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-04-25T10:33:21.186+0000 7f555f757640 -1 Falling back to public interface 2024-04-25T10:33:21.189 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-04-25T10:33:21.188+0000 7f63d3ddc640 -1 Falling back to public interface 2024-04-25T10:33:21.197 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-04-25T10:33:21.194+0000 7f1d5754c640 -1 Falling back to public interface 2024-04-25T10:33:21.358 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:21.356+0000 7fac10419040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T10:33:21.391 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:21.389+0000 7f65d0c10040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T10:33:21.406 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:21.404+0000 7fac10419040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T10:33:21.437 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:21.436+0000 7f65d0c10040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T10:33:21.565 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:21.562+0000 7fac10419040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T10:33:21.569 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:21.596 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:21.594+0000 7f65d0c10040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T10:33:21.669 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.667+0000 7f1d017c5640 1 Processor -- start 2024-04-25T10:33:21.670 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.667+0000 7f1d017c5640 1 -- start start 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1d017c5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1cfc0b1dd0 0x7f1cfc0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1d017c5640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cfc0b3740 con 0x7f1cfc147310 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1d017c5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cfc147720 con 0x7f1cfc0b8bc0 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1d017c5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1cfc1482d0 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1cf3fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1cfc147310 0x7f1cfc070620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57900/0 (socket says 172.21.15.103:57900) 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1cf3fff640 1 -- 172.21.15.103:0/2006295856 learned_addr learned my addr 172.21.15.103:0/2006295856 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1cfaffd640 1 --2- 172.21.15.103:0/2006295856 >> v2:172.21.15.132:3300/0 conn(0x7f1cfc0b1dd0 0x7f1cfc0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1cfa7fc640 1 -- 172.21.15.103:0/2006295856 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629486468 0 0) 0x7f1cfc0b3740 con 0x7f1cfc147310 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1cfa7fc640 1 -- 172.21.15.103:0/2006295856 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ce8003520 con 0x7f1cfc147310 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1cfaffd640 1 -- 172.21.15.103:0/2006295856 >> v1:172.21.15.132:6789/0 conn(0x7f1cfc0b8bc0 legacy=0x7f1cfc147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:21.672 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.668+0000 7f1cfaffd640 1 -- 172.21.15.103:0/2006295856 >> v1:172.21.15.103:6789/0 conn(0x7f1cfc147310 legacy=0x7f1cfc070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:21.673 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.669+0000 7f1cfaffd640 1 -- 172.21.15.103:0/2006295856 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc0b8fd0 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.673 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.669+0000 7f1cfaffd640 1 --2- 172.21.15.103:0/2006295856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc0b2340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0097a0 tx=0x7f1cec02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676f5fa06422783d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:21.673 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.669+0000 7f1cfa7fc640 1 -- 172.21.15.103:0/2006295856 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec037070 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.673 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.669+0000 7f1cfa7fc640 1 -- 172.21.15.103:0/2006295856 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cec032440 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.673 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.669+0000 7f1cfa7fc640 1 -- 172.21.15.103:0/2006295856 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec032810 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.674 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.670+0000 7f1d017c5640 1 -- 172.21.15.103:0/2006295856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b1dd0 msgr2=0x7f1cfc0b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:21.674 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.670+0000 7f1d017c5640 1 --2- 172.21.15.103:0/2006295856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc0b2340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0097a0 tx=0x7f1cec02a230 comp rx=0 tx=0).stop 2024-04-25T10:33:21.674 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.670+0000 7f1d017c5640 1 -- 172.21.15.103:0/2006295856 shutdown_connections 2024-04-25T10:33:21.674 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.670+0000 7f1d017c5640 1 --2- 172.21.15.103:0/2006295856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc0b2340 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:21.674 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.670+0000 7f1d017c5640 1 -- 172.21.15.103:0/2006295856 >> 172.21.15.103:0/2006295856 conn(0x7f1cfc0bcad0 msgr2=0x7f1cfc0bcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:21.675 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.670+0000 7f1d017c5640 1 -- 172.21.15.103:0/2006295856 shutdown_connections 2024-04-25T10:33:21.675 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.670+0000 7f1d017c5640 1 -- 172.21.15.103:0/2006295856 wait complete. 2024-04-25T10:33:21.675 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.672+0000 7f1d017c5640 1 Processor -- start 2024-04-25T10:33:21.675 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.672+0000 7f1d017c5640 1 -- start start 2024-04-25T10:33:21.678 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1d017c5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc1446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:21.678 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1d017c5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cfc0b8bc0 0x7f1cfc1e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:21.678 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1d017c5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc147310 0x7f1cfc1df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:21.678 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1d017c5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc152bc0 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.678 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1d017c5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1cfc0b8730 con 0x7f1cfc147310 2024-04-25T10:33:21.678 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1d017c5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1cfc152d40 con 0x7f1cfc0b8bc0 2024-04-25T10:33:21.678 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc1446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc1446d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34754/0 (socket says 172.21.15.103:34754) 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 -- 172.21.15.103:0/3524224068 learned_addr learned my addr 172.21.15.103:0/3524224068 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cf3fff640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cfc0b8bc0 0x7f1cfc1e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfb7fe640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc147310 0x7f1cfc1df9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 -- 172.21.15.103:0/3524224068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cfc0b8bc0 msgr2=0x7f1cfc1e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cfc0b8bc0 0x7f1cfc1e31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 -- 172.21.15.103:0/3524224068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc147310 msgr2=0x7f1cfc1df9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc147310 0x7f1cfc1df9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 -- 172.21.15.103:0/3524224068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cfc1e36e0 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cfaffd640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc1446d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0098c0 tx=0x7f1cec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.673+0000 7f1cf37fe640 1 -- 172.21.15.103:0/3524224068 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec037040 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.679 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.674+0000 7f1cf37fe640 1 -- 172.21.15.103:0/3524224068 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cec042070 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.680 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.674+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cfc0a03c0 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.680 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.674+0000 7f1cf37fe640 1 -- 172.21.15.103:0/3524224068 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec030940 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.680 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.674+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cfc0a0110 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.680 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.674+0000 7f1cf37fe640 1 -- 172.21.15.103:0/3524224068 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1cec030ae0 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.680 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.674+0000 7f1cf37fe640 1 -- 172.21.15.103:0/3524224068 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1cec047c80 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.680 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.675+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cfc050740 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.680 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.677+0000 7f1cf37fe640 1 -- 172.21.15.103:0/3524224068 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1cec047460 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.708 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:21.706+0000 7fac10419040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T10:33:21.733 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:21.732+0000 7f65d0c10040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T10:33:21.742 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.739+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cfc146cb0 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.742 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.740+0000 7f1cf37fe640 1 -- 172.21.15.103:0/3524224068 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1cec047640 con 0x7f1cfc0b1dd0 2024-04-25T10:33:21.742 INFO:teuthology.misc.health.smithi103.stdout: 2024-04-25T10:33:21.743 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":10,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:20.520610+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cfc0b1dd0 msgr2=0x7f1cfc1446d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc1446d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0098c0 tx=0x7f1cec0046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 shutdown_connections 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc147310 0x7f1cfc1df9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1cfc0b8bc0 0x7f1cfc1e31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 --2- 172.21.15.103:0/3524224068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1cfc0b1dd0 0x7f1cfc1446d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 >> 172.21.15.103:0/3524224068 conn(0x7f1cfc0bcad0 msgr2=0x7f1cfc13b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 shutdown_connections 2024-04-25T10:33:21.744 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:21.741+0000 7f1d017c5640 1 -- 172.21.15.103:0/3524224068 wait complete. 2024-04-25T10:33:21.753 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T10:33:21.761 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:21.759+0000 7fac10419040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T10:33:21.785 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:21.783+0000 7f65d0c10040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T10:33:21.833 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:21.830+0000 7fac10419040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T10:33:21.854 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:21.852+0000 7f65d0c10040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T10:33:21.878 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:21.876+0000 7fac10419040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T10:33:21.899 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:21.897+0000 7f65d0c10040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T10:33:22.364 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:22.362+0000 7fac10419040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T10:33:22.379 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:22.377+0000 7f65d0c10040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T10:33:22.480 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:22.478+0000 7fac10419040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T10:33:22.494 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-04-25T10:33:22.492+0000 7f65d0c10040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T10:33:23.496 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:23.494+0000 7fabb0340640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T10:33:23.497 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-04-25T10:33:23.495+0000 7fabb0340640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T10:33:24.657 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-04-25T10:33:24.655+0000 7f3bbd52c640 -1 osd.6 0 log_to_monitors true 2024-04-25T10:33:24.660 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-04-25T10:33:24.658+0000 7f555f757640 -1 osd.1 0 log_to_monitors true 2024-04-25T10:33:24.703 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-04-25T10:33:24.701+0000 7f75546e1640 -1 osd.4 0 log_to_monitors true 2024-04-25T10:33:24.704 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-04-25T10:33:24.701+0000 7fbf78501640 -1 osd.0 0 log_to_monitors true 2024-04-25T10:33:24.704 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-04-25T10:33:24.702+0000 7f3300ddc640 -1 osd.7 0 log_to_monitors true 2024-04-25T10:33:24.721 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-04-25T10:33:24.718+0000 7f1d5754c640 -1 osd.3 0 log_to_monitors true 2024-04-25T10:33:24.721 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-04-25T10:33:24.719+0000 7f4c18568640 -1 osd.2 0 log_to_monitors true 2024-04-25T10:33:24.730 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-04-25T10:33:24.728+0000 7f63d3ddc640 -1 osd.5 0 log_to_monitors true 2024-04-25T10:33:28.559 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:28.623 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-04-25T10:33:28.621+0000 7f3bb94c2640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T10:33:28.636 INFO:tasks.ceph.osd.6.smithi132.stderr:2024-04-25T10:33:28.635+0000 7f3bb12bd640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:33:28.645 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-04-25T10:33:28.644+0000 7f32fcd72640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T10:33:28.653 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-04-25T10:33:28.652+0000 7f555b6ed640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T10:33:28.653 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-04-25T10:33:28.652+0000 7f1d534e2640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T10:33:28.659 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-04-25T10:33:28.657+0000 7f63cfd72640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T10:33:28.659 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-04-25T10:33:28.657+0000 7f7550677640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T10:33:28.662 INFO:tasks.ceph.osd.7.smithi132.stderr:2024-04-25T10:33:28.660+0000 7f32f4b6d640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:33:28.670 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-04-25T10:33:28.669+0000 7f1d4b2dd640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:33:28.671 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-04-25T10:33:28.669+0000 7f55534e8640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:33:28.673 INFO:tasks.ceph.osd.5.smithi132.stderr:2024-04-25T10:33:28.672+0000 7f63c7b6d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:33:28.678 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-04-25T10:33:28.677+0000 7fbf74497640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T10:33:28.679 INFO:tasks.ceph.osd.4.smithi132.stderr:2024-04-25T10:33:28.678+0000 7f7548472640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:33:28.694 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-04-25T10:33:28.693+0000 7fbf6c292640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:33:28.702 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.701+0000 7fe9a8f84640 1 Processor -- start 2024-04-25T10:33:28.702 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.701+0000 7fe9a8f84640 1 -- start start 2024-04-25T10:33:28.704 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a8f84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a414c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:28.704 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a8f84640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a406f100 0x7fe9a406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a8f84640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a414bc70 con 0x7fe9a40689c0 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a8f84640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a414caa0 con 0x7fe9a406f100 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a8f84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a40b5a10 con 0x7fe9a414c150 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a2d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a406f100 0x7fe9a406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a2d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe9a406f100 0x7fe9a406f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59804/0 (socket says 172.21.15.103:59804) 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a2d9d640 1 -- 172.21.15.103:0/1987734126 learned_addr learned my addr 172.21.15.103:0/1987734126 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a1d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a159a640 1 -- 172.21.15.103:0/1987734126 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430672885 0 0) 0x7fe9a414bc70 con 0x7fe9a40689c0 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a2d9d640 1 -- 172.21.15.103:0/1987734126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 msgr2=0x7fe9a414c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a2d9d640 1 --2- 172.21.15.103:0/1987734126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a414c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a2d9d640 1 -- 172.21.15.103:0/1987734126 >> v1:172.21.15.132:6789/0 conn(0x7fe9a40689c0 legacy=0x7fe9a40b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.702+0000 7fe9a2d9d640 1 -- 172.21.15.103:0/1987734126 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a40b7520 con 0x7fe9a406f100 2024-04-25T10:33:28.705 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.703+0000 7fe9a2d9d640 1 --2- 172.21.15.103:0/1987734126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a406f100 0x7fe9a406f510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009e50 tx=0x7fe99c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff0e6c9a1be9468 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:28.706 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.703+0000 7fe9a159a640 1 -- 172.21.15.103:0/1987734126 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c036070 con 0x7fe9a406f100 2024-04-25T10:33:28.706 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.703+0000 7fe9a159a640 1 -- 172.21.15.103:0/1987734126 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99c031600 con 0x7fe9a406f100 2024-04-25T10:33:28.706 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.703+0000 7fe9a159a640 1 -- 172.21.15.103:0/1987734126 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c0319d0 con 0x7fe9a406f100 2024-04-25T10:33:28.707 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.704+0000 7fe9a8f84640 1 -- 172.21.15.103:0/1987734126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a406f100 msgr2=0x7fe9a406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:28.707 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.704+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/1987734126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a406f100 0x7fe9a406f510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009e50 tx=0x7fe99c02a680 comp rx=0 tx=0).stop 2024-04-25T10:33:28.707 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.704+0000 7fe9a8f84640 1 -- 172.21.15.103:0/1987734126 shutdown_connections 2024-04-25T10:33:28.707 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.704+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/1987734126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a406f100 0x7fe9a406f510 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.707 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.704+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/1987734126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.707 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.704+0000 7fe9a8f84640 1 -- 172.21.15.103:0/1987734126 >> 172.21.15.103:0/1987734126 conn(0x7fe9a40720d0 msgr2=0x7fe9a409ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:28.707 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.704+0000 7fe9a8f84640 1 -- 172.21.15.103:0/1987734126 shutdown_connections 2024-04-25T10:33:28.707 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.704+0000 7fe9a8f84640 1 -- 172.21.15.103:0/1987734126 wait complete. 2024-04-25T10:33:28.708 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.706+0000 7fe9a8f84640 1 Processor -- start 2024-04-25T10:33:28.708 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.706+0000 7fe9a8f84640 1 -- start start 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a8f84640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a40689c0 0x7fe9a40b9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a8f84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a406f100 0x7fe9a41df4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a8f84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a41436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a8f84640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a406fa50 con 0x7fe9a40689c0 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a40689c0 0x7fe9a40b9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a8f84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a40b7800 con 0x7fe9a406f100 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a40689c0 0x7fe9a40b9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59808/0 (socket says 172.21.15.103:59808) 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a259c640 1 -- 172.21.15.103:0/2439151159 learned_addr learned my addr 172.21.15.103:0/2439151159 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a40b7130 con 0x7fe9a414c150 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a2d9d640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a41436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.707+0000 7fe9a1d9b640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a406f100 0x7fe9a41df4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:28.710 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a2d9d640 1 -- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a406f100 msgr2=0x7fe9a41df4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:28.711 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a2d9d640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a406f100 0x7fe9a41df4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.711 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a2d9d640 1 -- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a40689c0 msgr2=0x7fe9a40b9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:28.711 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a2d9d640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a40689c0 0x7fe9a40b9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.711 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a2d9d640 1 -- 172.21.15.103:0/2439151159 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a40ba530 con 0x7fe9a414c150 2024-04-25T10:33:28.711 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a259c640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a40689c0 0x7fe9a40b9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:28.711 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a2d9d640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a41436f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe99c030000 tx=0x7fe99c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:28.711 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-04-25T10:33:28.708+0000 7f4c144fe640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T10:33:28.712 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe992ffd640 1 -- 172.21.15.103:0/2439151159 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c041020 con 0x7fe9a414c150 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe992ffd640 1 -- 172.21.15.103:0/2439151159 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99c037040 con 0x7fe9a414c150 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a41dfa20 con 0x7fe9a414c150 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe992ffd640 1 -- 172.21.15.103:0/2439151159 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c036050 con 0x7fe9a414c150 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.708+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a40b97f0 con 0x7fe9a414c150 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.709+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a4050740 con 0x7fe9a414c150 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.710+0000 7fe992ffd640 1 -- 172.21.15.103:0/2439151159 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 4) ==== 96726+0+0 (secure 0 0 0) 0x7fe99c007c70 con 0x7fe9a414c150 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.711+0000 7fe992ffd640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe984074470 0x7fe984076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.711+0000 7fe992ffd640 1 -- 172.21.15.103:0/2439151159 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fe99c0b4780 con 0x7fe9a414c150 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.711+0000 7fe9a259c640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe984074470 0x7fe984076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:28.713 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.711+0000 7fe9a259c640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe984074470 0x7fe984076980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe994001be0 tx=0x7fe994009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:28.720 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-04-25T10:33:28.719+0000 7f4c0c2f9640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:33:28.720 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.719+0000 7fe992ffd640 1 -- 172.21.15.103:0/2439151159 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe99c04b060 con 0x7fe9a414c150 2024-04-25T10:33:28.899 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.897+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9a414b670 con 0x7fe9a414c150 2024-04-25T10:33:28.900 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.898+0000 7fe992ffd640 1 -- 172.21.15.103:0/2439151159 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fe99c07f8a0 con 0x7fe9a414c150 2024-04-25T10:33:28.900 INFO:teuthology.misc.health.smithi103.stdout: 2024-04-25T10:33:28.900 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":12,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:26.500812+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:28.902 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe984074470 msgr2=0x7fe984076980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:28.902 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe984074470 0x7fe984076980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe994001be0 tx=0x7fe994009040 comp rx=0 tx=0).stop 2024-04-25T10:33:28.902 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 msgr2=0x7fe9a41436f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:28.902 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a41436f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe99c030000 tx=0x7fe99c004a40 comp rx=0 tx=0).stop 2024-04-25T10:33:28.902 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 shutdown_connections 2024-04-25T10:33:28.903 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe984074470 0x7fe984076980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.903 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe9a414c150 0x7fe9a41436f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.903 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a406f100 0x7fe9a41df4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.903 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 --2- 172.21.15.103:0/2439151159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9a40689c0 0x7fe9a40b9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:28.903 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 >> 172.21.15.103:0/2439151159 conn(0x7fe9a40720d0 msgr2=0x7fe9a4148470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:28.903 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 shutdown_connections 2024-04-25T10:33:28.903 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:28.900+0000 7fe9a8f84640 1 -- 172.21.15.103:0/2439151159 wait complete. 2024-04-25T10:33:28.912 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T10:33:35.719 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:35.833 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.831+0000 7f6303b57640 1 Processor -- start 2024-04-25T10:33:35.833 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.831+0000 7f6303b57640 1 -- start start 2024-04-25T10:33:35.835 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.832+0000 7f6303b57640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc0a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:35.835 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.832+0000 7f6303b57640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62fc0a0df0 0x7f62fc1495c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:35.835 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.832+0000 7f6303b57640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62fc14d9f0 con 0x7f62fc149b00 2024-04-25T10:33:35.835 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.832+0000 7f6303b57640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f62fc09efc0 con 0x7f62fc0a0df0 2024-04-25T10:33:35.835 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.832+0000 7f6303b57640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f62fc14cf10 con 0x7f62fc0bbf50 2024-04-25T10:33:35.835 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63010f2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62fc0a0df0 0x7f62fc1495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63020f4640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f62fc149b00 0x7f62fc0b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51848/0 (socket says 172.21.15.103:51848) 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63020f4640 1 -- 172.21.15.103:0/1693852301 learned_addr learned my addr 172.21.15.103:0/1693852301 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63018f3640 1 --2- 172.21.15.103:0/1693852301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc0a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63010f2640 1 -- 172.21.15.103:0/1693852301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 msgr2=0x7f62fc0a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63010f2640 1 --2- 172.21.15.103:0/1693852301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc0a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63010f2640 1 -- 172.21.15.103:0/1693852301 >> v1:172.21.15.103:6789/0 conn(0x7f62fc149b00 legacy=0x7f62fc0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63010f2640 1 -- 172.21.15.103:0/1693852301 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc14d1f0 con 0x7f62fc0a0df0 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63008f1640 1 -- 172.21.15.103:0/1693852301 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699027623 0 0) 0x7f62fc14d9f0 con 0x7f62fc149b00 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.833+0000 7f63018f3640 1 --2- 172.21.15.103:0/1693852301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc0a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.834+0000 7f63010f2640 1 --2- 172.21.15.103:0/1693852301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc1495c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0097a0 tx=0x7f62ec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c408ed253fec69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.834+0000 7f63008f1640 1 -- 172.21.15.103:0/1693852301 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec037070 con 0x7f62fc0a0df0 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.834+0000 7f63008f1640 1 -- 172.21.15.103:0/1693852301 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62ec02ae50 con 0x7f62fc0a0df0 2024-04-25T10:33:35.836 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.834+0000 7f63008f1640 1 -- 172.21.15.103:0/1693852301 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec032660 con 0x7f62fc0a0df0 2024-04-25T10:33:35.837 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.834+0000 7f6303b57640 1 -- 172.21.15.103:0/1693852301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 msgr2=0x7f62fc1495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.834+0000 7f6303b57640 1 --2- 172.21.15.103:0/1693852301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc1495c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0097a0 tx=0x7f62ec02a100 comp rx=0 tx=0).stop 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.835+0000 7f6303b57640 1 -- 172.21.15.103:0/1693852301 shutdown_connections 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.835+0000 7f6303b57640 1 --2- 172.21.15.103:0/1693852301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc1495c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.835+0000 7f6303b57640 1 --2- 172.21.15.103:0/1693852301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc0a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.835+0000 7f6303b57640 1 -- 172.21.15.103:0/1693852301 >> 172.21.15.103:0/1693852301 conn(0x7f62fc0bf7b0 msgr2=0x7f62fc0bb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.835+0000 7f6303b57640 1 -- 172.21.15.103:0/1693852301 shutdown_connections 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.835+0000 7f6303b57640 1 -- 172.21.15.103:0/1693852301 wait complete. 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.836+0000 7f6303b57640 1 Processor -- start 2024-04-25T10:33:35.838 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.836+0000 7f6303b57640 1 -- start start 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f6303b57640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f6303b57640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc1df760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f6303b57640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62fc149b00 0x7f62fc0b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f6303b57640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0a1430 con 0x7f62fc0a0df0 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f6303b57640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0bc360 con 0x7f62fc149b00 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f6303b57640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f62fc14cb30 con 0x7f62fc0bbf50 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f63018f3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f63018f3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc0b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38886/0 (socket says 172.21.15.103:38886) 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f63018f3640 1 -- 172.21.15.103:0/2869563988 learned_addr learned my addr 172.21.15.103:0/2869563988 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f63010f2640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc1df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:35.841 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.837+0000 7f63020f4640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62fc149b00 0x7f62fc0b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f63018f3640 1 -- 172.21.15.103:0/2869563988 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 msgr2=0x7f62fc1df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f63018f3640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc1df760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f63018f3640 1 -- 172.21.15.103:0/2869563988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62fc149b00 msgr2=0x7f62fc0b84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f63018f3640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62fc149b00 0x7f62fc0b84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f63018f3640 1 -- 172.21.15.103:0/2869563988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc1dfca0 con 0x7f62fc0a0df0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f63018f3640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc0b3d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62f800d7d0 tx=0x7f62f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f62f27fc640 1 -- 172.21.15.103:0/2869563988 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8004030 con 0x7f62fc0a0df0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f62f27fc640 1 -- 172.21.15.103:0/2869563988 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f80041d0 con 0x7f62fc0a0df0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f62f27fc640 1 -- 172.21.15.103:0/2869563988 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f800b6c0 con 0x7f62fc0a0df0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc0b3070 con 0x7f62fc0a0df0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.838+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc0b3630 con 0x7f62fc0a0df0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.839+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62fc050740 con 0x7f62fc0a0df0 2024-04-25T10:33:35.842 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.840+0000 7f62f27fc640 1 -- 172.21.15.103:0/2869563988 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f62f800b860 con 0x7f62fc0a0df0 2024-04-25T10:33:35.843 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.840+0000 7f62f27fc640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62e00744b0 0x7f62e00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:35.843 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.840+0000 7f63010f2640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62e00744b0 0x7f62e00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:35.843 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.840+0000 7f62f27fc640 1 -- 172.21.15.103:0/2869563988 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f62f80951a0 con 0x7f62fc0a0df0 2024-04-25T10:33:35.843 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.841+0000 7f63010f2640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62e00744b0 0x7f62e00769c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62ec034000 tx=0x7f62ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:35.846 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:35.845+0000 7f62f27fc640 1 -- 172.21.15.103:0/2869563988 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f62f805fc80 con 0x7f62fc0a0df0 2024-04-25T10:33:36.023 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.021+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62fc0bb140 con 0x7f62fc0a0df0 2024-04-25T10:33:36.024 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.022+0000 7f62f27fc640 1 -- 172.21.15.103:0/2869563988 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12944 (secure 0 0 0) 0x7f62f805f580 con 0x7f62fc0a0df0 2024-04-25T10:33:36.024 INFO:teuthology.misc.health.smithi103.stdout: 2024-04-25T10:33:36.024 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":16,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:32.632156+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:36.026 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62e00744b0 msgr2=0x7f62e00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.026 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62e00744b0 0x7f62e00769c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62ec034000 tx=0x7f62ec02e000 comp rx=0 tx=0).stop 2024-04-25T10:33:36.026 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 msgr2=0x7f62fc0b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.026 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc0b3d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62f800d7d0 tx=0x7f62f800dc90 comp rx=0 tx=0).stop 2024-04-25T10:33:36.026 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 shutdown_connections 2024-04-25T10:33:36.027 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62e00744b0 0x7f62e00769c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.027 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62fc149b00 0x7f62fc0b84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.027 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62fc0bbf50 0x7f62fc1df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.027 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 --2- 172.21.15.103:0/2869563988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62fc0a0df0 0x7f62fc0b3d10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.027 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 >> 172.21.15.103:0/2869563988 conn(0x7f62fc0bf7b0 msgr2=0x7f62fc09c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:36.027 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 shutdown_connections 2024-04-25T10:33:36.027 INFO:teuthology.misc.health.smithi103.stderr:2024-04-25T10:33:36.024+0000 7f6303b57640 1 -- 172.21.15.103:0/2869563988 wait complete. 2024-04-25T10:33:36.036 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T10:33:36.036 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T10:33:36.036 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:33:36.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:33:36.039 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:33:36.039 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:33:36.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:33:36.042 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:33:36.042 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T10:33:36.042 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:36.122 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-04-25T10:33:36.137 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2024-04-25T10:33:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.152+0000 7f25e815f640 1 Processor -- start 2024-04-25T10:33:36.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.153+0000 7f25e815f640 1 -- start start 2024-04-25T10:33:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.153+0000 7f25e815f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e0143960 0x7f25e0149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e815f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25e00be4c0 0x7f25e00bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e815f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25e006d2d0 0x7f25e006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e815f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f25e00be030 con 0x7f25e006d2d0 2024-04-25T10:33:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e815f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f25e00bda00 con 0x7f25e00be4c0 2024-04-25T10:33:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e815f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f25e01499c0 con 0x7f25e0143960 2024-04-25T10:33:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e66fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25e006d2d0 0x7f25e006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e66fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25e006d2d0 0x7f25e006d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38914/0 (socket says 172.21.15.103:38914) 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e66fc640 1 -- 172.21.15.103:0/1295956035 learned_addr learned my addr 172.21.15.103:0/1295956035 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e56fa640 1 --2- 172.21.15.103:0/1295956035 >> v2:172.21.15.132:3300/0 conn(0x7f25e00be4c0 0x7f25e00bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e5efb640 1 --2- 172.21.15.103:0/1295956035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e0143960 0x7f25e0149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e66fc640 1 -- 172.21.15.103:0/1295956035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e0143960 msgr2=0x7f25e0149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e66fc640 1 --2- 172.21.15.103:0/1295956035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e0143960 0x7f25e0149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e66fc640 1 -- 172.21.15.103:0/1295956035 >> v2:172.21.15.132:3300/0 conn(0x7f25e00be4c0 msgr2=0x7f25e00bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e66fc640 1 --2- 172.21.15.103:0/1295956035 >> v2:172.21.15.132:3300/0 conn(0x7f25e00be4c0 0x7f25e00bbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.154+0000 7f25e66fc640 1 -- 172.21.15.103:0/1295956035 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e00bdcc0 con 0x7f25e006d2d0 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e66fc640 1 --2- 172.21.15.103:0/1295956035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e006d2d0 0x7f25e006d6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25e008cec0 tx=0x7f25d802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6231435717b4a91d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e4ef9640 1 -- 172.21.15.103:0/1295956035 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8036070 con 0x7f25e006d2d0 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e4ef9640 1 -- 172.21.15.103:0/1295956035 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d8031600 con 0x7f25e006d2d0 2024-04-25T10:33:36.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e4ef9640 1 -- 172.21.15.103:0/1295956035 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d80319d0 con 0x7f25e006d2d0 2024-04-25T10:33:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e815f640 1 -- 172.21.15.103:0/1295956035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e006d2d0 msgr2=0x7f25e006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e815f640 1 --2- 172.21.15.103:0/1295956035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e006d2d0 0x7f25e006d6e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25e008cec0 tx=0x7f25d802a610 comp rx=0 tx=0).stop 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e815f640 1 -- 172.21.15.103:0/1295956035 shutdown_connections 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e815f640 1 --2- 172.21.15.103:0/1295956035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e006d2d0 0x7f25e006d6e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e815f640 1 --2- 172.21.15.103:0/1295956035 >> v2:172.21.15.132:3300/0 conn(0x7f25e00be4c0 0x7f25e00bbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e815f640 1 --2- 172.21.15.103:0/1295956035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e0143960 0x7f25e0149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.155+0000 7f25e815f640 1 -- 172.21.15.103:0/1295956035 >> 172.21.15.103:0/1295956035 conn(0x7f25e00befa0 msgr2=0x7f25e00bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.156+0000 7f25e815f640 1 -- 172.21.15.103:0/1295956035 shutdown_connections 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.156+0000 7f25e815f640 1 -- 172.21.15.103:0/1295956035 wait complete. 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.157+0000 7f25e815f640 1 Processor -- start 2024-04-25T10:33:36.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.157+0000 7f25e815f640 1 -- start start 2024-04-25T10:33:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e815f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e006d2d0 0x7f25e0142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e815f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e00be4c0 0x7f25e01ded10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e815f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25e0143960 0x7f25e01e2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e815f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f25e00bc1c0 con 0x7f25e00be4c0 2024-04-25T10:33:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e815f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f25e00bc040 con 0x7f25e0143960 2024-04-25T10:33:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e815f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f25e014ca10 con 0x7f25e006d2d0 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e56fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e00be4c0 0x7f25e01ded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e56fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e00be4c0 0x7f25e01ded10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38930/0 (socket says 172.21.15.103:38930) 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e56fa640 1 -- 172.21.15.103:0/2096538409 learned_addr learned my addr 172.21.15.103:0/2096538409 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e5efb640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e006d2d0 0x7f25e0142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e66fc640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25e0143960 0x7f25e01e2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e56fa640 1 -- 172.21.15.103:0/2096538409 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e006d2d0 msgr2=0x7f25e0142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e56fa640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e006d2d0 0x7f25e0142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e56fa640 1 -- 172.21.15.103:0/2096538409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25e0143960 msgr2=0x7f25e01e2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e56fa640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25e0143960 0x7f25e01e2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.158+0000 7f25e56fa640 1 -- 172.21.15.103:0/2096538409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e01df250 con 0x7f25e00be4c0 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.159+0000 7f25e56fa640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e00be4c0 0x7f25e01ded10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25d000e8a0 tx=0x7f25d000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.159+0000 7f25d67fc640 1 -- 172.21.15.103:0/2096538409 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0017070 con 0x7f25e00be4c0 2024-04-25T10:33:36.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.159+0000 7f25d67fc640 1 -- 172.21.15.103:0/2096538409 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d000c940 con 0x7f25e00be4c0 2024-04-25T10:33:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.159+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e013ee30 con 0x7f25e00be4c0 2024-04-25T10:33:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.159+0000 7f25d67fc640 1 -- 172.21.15.103:0/2096538409 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d000cd30 con 0x7f25e00be4c0 2024-04-25T10:33:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.159+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e013e1c0 con 0x7f25e00be4c0 2024-04-25T10:33:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.160+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e006a130 con 0x7f25e00be4c0 2024-04-25T10:33:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.160+0000 7f25d67fc640 1 -- 172.21.15.103:0/2096538409 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f25d001a070 con 0x7f25e00be4c0 2024-04-25T10:33:36.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.161+0000 7f25d67fc640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f25c40744e0 0x7f25c40769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.161+0000 7f25d67fc640 1 -- 172.21.15.103:0/2096538409 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f25d0095030 con 0x7f25e00be4c0 2024-04-25T10:33:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.161+0000 7f25e5efb640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f25c40744e0 0x7f25c40769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.161+0000 7f25e5efb640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f25c40744e0 0x7f25c40769f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25e00b93e0 tx=0x7f25dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.165+0000 7f25d67fc640 1 -- 172.21.15.103:0/2096538409 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25d005f550 con 0x7f25e00be4c0 2024-04-25T10:33:36.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.341+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25e00b8da0 con 0x7f25e00be4c0 2024-04-25T10:33:36.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.342+0000 7f25d67fc640 1 -- 172.21.15.103:0/2096538409 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12944 (secure 0 0 0) 0x7f25d0063850 con 0x7f25e00be4c0 2024-04-25T10:33:36.344 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:36.344 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:32.632156+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:36.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f25c40744e0 msgr2=0x7f25c40769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f25c40744e0 0x7f25c40769f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25e00b93e0 tx=0x7f25dc008040 comp rx=0 tx=0).stop 2024-04-25T10:33:36.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e00be4c0 msgr2=0x7f25e01ded10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e00be4c0 0x7f25e01ded10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25d000e8a0 tx=0x7f25d000ed60 comp rx=0 tx=0).stop 2024-04-25T10:33:36.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 shutdown_connections 2024-04-25T10:33:36.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f25c40744e0 0x7f25c40769f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25e0143960 0x7f25e01e2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25e00be4c0 0x7f25e01ded10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 --2- 172.21.15.103:0/2096538409 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f25e006d2d0 0x7f25e0142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 >> 172.21.15.103:0/2096538409 conn(0x7f25e00befa0 msgr2=0x7f25e00ba660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 shutdown_connections 2024-04-25T10:33:36.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.344+0000 7f25e815f640 1 -- 172.21.15.103:0/2096538409 wait complete. 2024-04-25T10:33:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:33:30.507871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:33:36.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:33:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.466+0000 7f2dbe434640 1 Processor -- start 2024-04-25T10:33:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.466+0000 7f2dbe434640 1 -- start start 2024-04-25T10:33:36.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.467+0000 7f2dbe434640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2db806d6d0 0x7f2db8149640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.467+0000 7f2dbe434640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db80b9a30 con 0x7f2db806dae0 2024-04-25T10:33:36.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.467+0000 7f2dbe434640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db80b9d10 con 0x7f2db809d820 2024-04-25T10:33:36.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.467+0000 7f2dbe434640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2db80b9ff0 con 0x7f2db806d6d0 2024-04-25T10:33:36.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2dbc9d1640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2db806dae0 0x7f2db8153ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51876/0 (socket says 172.21.15.103:51876) 2024-04-25T10:33:36.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2dbc9d1640 1 -- 172.21.15.103:0/4202276253 learned_addr learned my addr 172.21.15.103:0/4202276253 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:36.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db77fe640 1 --2- 172.21.15.103:0/4202276253 >> v2:172.21.15.132:3300/0 conn(0x7f2db806d6d0 0x7f2db8149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3055891229 0 0) 0x7f2db80b9a30 con 0x7f2db806dae0 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2da0003520 con 0x7f2db806dae0 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1327469069 0 0) 0x7f2da0003520 con 0x7f2db806dae0 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 >> v2:172.21.15.132:3300/0 conn(0x7f2db806d6d0 msgr2=0x7f2db8149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 --2- 172.21.15.103:0/4202276253 >> v2:172.21.15.132:3300/0 conn(0x7f2db806d6d0 0x7f2db8149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 >> v1:172.21.15.132:6789/0 conn(0x7f2db809d820 legacy=0x7f2db80bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db809dc30 con 0x7f2db806dae0 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f2db00019f0 con 0x7f2db806dae0 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 >> v1:172.21.15.103:6789/0 conn(0x7f2db806dae0 legacy=0x7f2db8153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2da00039b0 0x7f2da0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2da0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2da0005250 0x7f2da000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80b9ff0 con 0x7f2da0004800 2024-04-25T10:33:36.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2da000c1e0 con 0x7f2da00039b0 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f2da000c3e0 con 0x7f2da0005250 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db77fe640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2da0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2db7fff640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2da00039b0 0x7f2da0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.468+0000 7f2dbc9d1640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2da0005250 0x7f2da000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2db77fe640 1 -- 172.21.15.103:0/4202276253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2da0005250 msgr2=0x7f2da000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2db77fe640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2da0005250 0x7f2da000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2db77fe640 1 -- 172.21.15.103:0/4202276253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2da00039b0 msgr2=0x7f2da0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2db77fe640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2da00039b0 0x7f2da0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2db77fe640 1 -- 172.21.15.103:0/4202276253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da0003520 con 0x7f2da0004800 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2dbc9d1640 1 -- 172.21.15.103:0/4202276253 reap_dead start 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2db77fe640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2da0004c10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009ac0 tx=0x7f2da0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979cef0d21b36977 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac036070 con 0x7f2da0004800 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.469+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dac031400 con 0x7f2da0004800 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.470+0000 7f2db6ffd640 1 -- 172.21.15.103:0/4202276253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac009690 con 0x7f2da0004800 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.470+0000 7f2dbe434640 1 -- 172.21.15.103:0/4202276253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 msgr2=0x7f2da0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.470+0000 7f2dbe434640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2da0004c10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009ac0 tx=0x7f2da0005830 comp rx=0 tx=0).stop 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.470+0000 7f2dbe434640 1 -- 172.21.15.103:0/4202276253 shutdown_connections 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.470+0000 7f2dbe434640 1 --2- 172.21.15.103:0/4202276253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2da0004c10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.470+0000 7f2dbe434640 1 -- 172.21.15.103:0/4202276253 >> 172.21.15.103:0/4202276253 conn(0x7f2db80bee10 msgr2=0x7f2db80bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.470+0000 7f2dbe434640 1 -- 172.21.15.103:0/4202276253 shutdown_connections 2024-04-25T10:33:36.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.470+0000 7f2dbe434640 1 -- 172.21.15.103:0/4202276253 wait complete. 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.472+0000 7f2dbe434640 1 Processor -- start 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.472+0000 7f2dbe434640 1 -- start start 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2dbe434640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2db81e0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2dbe434640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2db80a1a10 0x7f2db81d5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2dbe434640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2db81e2eb0 0x7f2db81e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2dbe434640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80b9640 con 0x7f2da0004800 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2dbe434640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80b94c0 con 0x7f2db80a1a10 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2dbe434640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f2db80bdf70 con 0x7f2db81e2eb0 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2db81e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2db81e0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38946/0 (socket says 172.21.15.103:38946) 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 -- 172.21.15.103:0/167891734 learned_addr learned my addr 172.21.15.103:0/167891734 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db77fe640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2db80a1a10 0x7f2db81d5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2dbc9d1640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2db81e2eb0 0x7f2db81e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 -- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2db81e2eb0 msgr2=0x7f2db81e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2db81e2eb0 0x7f2db81e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 -- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2db80a1a10 msgr2=0x7f2db81d5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2db80a1a10 0x7f2db81d5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 -- 172.21.15.103:0/167891734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db81df550 con 0x7f2da0004800 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2dbc9d1640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2db81e2eb0 0x7f2db81e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db77fe640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2db80a1a10 0x7f2db81d5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.473+0000 7f2db7fff640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2db81e0010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2da800f5f0 tx=0x7f2da800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.474+0000 7f2db4ff9640 1 -- 172.21.15.103:0/167891734 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da80052e0 con 0x7f2da0004800 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.474+0000 7f2db4ff9640 1 -- 172.21.15.103:0/167891734 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da8018070 con 0x7f2da0004800 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.474+0000 7f2db4ff9640 1 -- 172.21.15.103:0/167891734 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8003810 con 0x7f2da0004800 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.474+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db81df810 con 0x7f2da0004800 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.474+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db81d6830 con 0x7f2da0004800 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.475+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db806a130 con 0x7f2da0004800 2024-04-25T10:33:36.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.475+0000 7f2db4ff9640 1 -- 172.21.15.103:0/167891734 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2da80039b0 con 0x7f2da0004800 2024-04-25T10:33:36.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.476+0000 7f2db4ff9640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2da40744b0 0x7f2da40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.476+0000 7f2db4ff9640 1 -- 172.21.15.103:0/167891734 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2da8094c80 con 0x7f2da0004800 2024-04-25T10:33:36.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.476+0000 7f2db77fe640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2da40744b0 0x7f2da40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.476+0000 7f2db77fe640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2da40744b0 0x7f2da40769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2dac033000 tx=0x7f2dac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.480+0000 7f2db4ff9640 1 -- 172.21.15.103:0/167891734 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2da805f7f0 con 0x7f2da0004800 2024-04-25T10:33:36.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.657+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2db80bb250 con 0x7f2da0004800 2024-04-25T10:33:36.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.657+0000 7f2db4ff9640 1 -- 172.21.15.103:0/167891734 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f2da805f0f0 con 0x7f2da0004800 2024-04-25T10:33:36.659 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-04-25T10:33:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2da40744b0 msgr2=0x7f2da40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2da40744b0 0x7f2da40769c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2dac033000 tx=0x7f2dac008030 comp rx=0 tx=0).stop 2024-04-25T10:33:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 msgr2=0x7f2db81e0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2db81e0010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2da800f5f0 tx=0x7f2da800fab0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 shutdown_connections 2024-04-25T10:33:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2da40744b0 0x7f2da40769c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2db81e2eb0 0x7f2db81e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2db80a1a10 0x7f2db81d5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 --2- 172.21.15.103:0/167891734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2da0004800 0x7f2db81e0010 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 >> 172.21.15.103:0/167891734 conn(0x7f2db80bee10 msgr2=0x7f2db80bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 shutdown_connections 2024-04-25T10:33:36.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.659+0000 7f2dbe434640 1 -- 172.21.15.103:0/167891734 wait complete. 2024-04-25T10:33:36.672 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:33:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.778+0000 7fc4a52a7640 1 Processor -- start 2024-04-25T10:33:36.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.779+0000 7fc4a52a7640 1 -- start start 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc4a52a7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a014b820 0x7fc4a00bc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc4a52a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc4a0140f20 0x7fc4a0141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc4a52a7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a00b7a70 con 0x7fc4a00b7660 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc4a52a7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a00b7fd0 con 0x7fc4a0140f20 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc4a52a7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a00b7cf0 con 0x7fc4a014b820 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49effd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc4a00b7660 0x7fc4a014b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51880/0 (socket says 172.21.15.103:51880) 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49effd640 1 -- 172.21.15.103:0/3813326881 learned_addr learned my addr 172.21.15.103:0/3813326881 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49f7fe640 1 --2- 172.21.15.103:0/3813326881 >> v2:172.21.15.132:3300/0 conn(0x7fc4a0140f20 0x7fc4a0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49e7fc640 1 --2- 172.21.15.103:0/3813326881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a014b820 0x7fc4a00bc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49dffb640 1 -- 172.21.15.103:0/3813326881 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616476963 0 0) 0x7fc490001490 con 0x7fc4a00b7660 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49dffb640 1 -- 172.21.15.103:0/3813326881 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc488003520 con 0x7fc4a00b7660 2024-04-25T10:33:36.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49dffb640 1 -- 172.21.15.103:0/3813326881 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3389822361 0 0) 0x7fc488003520 con 0x7fc4a00b7660 2024-04-25T10:33:36.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49e7fc640 1 -- 172.21.15.103:0/3813326881 >> v2:172.21.15.132:3300/0 conn(0x7fc4a0140f20 msgr2=0x7fc4a0141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:36.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49e7fc640 1 --2- 172.21.15.103:0/3813326881 >> v2:172.21.15.132:3300/0 conn(0x7fc4a0140f20 0x7fc4a0141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49e7fc640 1 -- 172.21.15.103:0/3813326881 >> v1:172.21.15.103:6789/0 conn(0x7fc4a00b7660 legacy=0x7fc4a014b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.780+0000 7fc49e7fc640 1 -- 172.21.15.103:0/3813326881 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a014abf0 con 0x7fc4a014b820 2024-04-25T10:33:36.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.781+0000 7fc49e7fc640 1 --2- 172.21.15.103:0/3813326881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a014b820 0x7fc4a00bc110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc4940097a0 tx=0x7fc49402a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab276abe2506d1ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.781+0000 7fc49dffb640 1 -- 172.21.15.103:0/3813326881 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494037070 con 0x7fc4a014b820 2024-04-25T10:33:36.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.781+0000 7fc49dffb640 1 -- 172.21.15.103:0/3813326881 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49402aa90 con 0x7fc4a014b820 2024-04-25T10:33:36.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.781+0000 7fc49dffb640 1 -- 172.21.15.103:0/3813326881 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490001bc0 con 0x7fc4a014b820 2024-04-25T10:33:36.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.782+0000 7fc4a52a7640 1 -- 172.21.15.103:0/3813326881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a014b820 msgr2=0x7fc4a00bc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.782+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/3813326881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a014b820 0x7fc4a00bc110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc4940097a0 tx=0x7fc49402a000 comp rx=0 tx=0).stop 2024-04-25T10:33:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.782+0000 7fc4a52a7640 1 -- 172.21.15.103:0/3813326881 shutdown_connections 2024-04-25T10:33:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.782+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/3813326881 >> v2:172.21.15.132:3300/0 conn(0x7fc4a0140f20 0x7fc4a0141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.782+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/3813326881 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a014b820 0x7fc4a00bc110 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.782+0000 7fc4a52a7640 1 -- 172.21.15.103:0/3813326881 >> 172.21.15.103:0/3813326881 conn(0x7fc4a006e700 msgr2=0x7fc4a00bb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.782+0000 7fc4a52a7640 1 -- 172.21.15.103:0/3813326881 shutdown_connections 2024-04-25T10:33:36.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.782+0000 7fc4a52a7640 1 -- 172.21.15.103:0/3813326881 wait complete. 2024-04-25T10:33:36.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.784+0000 7fc4a52a7640 1 Processor -- start 2024-04-25T10:33:36.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.784+0000 7fc4a52a7640 1 -- start start 2024-04-25T10:33:36.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4a52a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4a00b7660 0x7fc4a0145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4a52a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4a0140f20 0x7fc4a013f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4a52a7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a0146680 0x7fc4a0145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4a52a7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0073cf0 con 0x7fc4a0140f20 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4a52a7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0073b70 con 0x7fc4a00b7660 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4a52a7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a0141870 con 0x7fc4a0146680 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4a0140f20 0x7fc4a013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4a0140f20 0x7fc4a013f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38954/0 (socket says 172.21.15.103:38954) 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 -- 172.21.15.103:0/4240231420 learned_addr learned my addr 172.21.15.103:0/4240231420 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49f7fe640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a0146680 0x7fc4a0145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49effd640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4a00b7660 0x7fc4a0145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 -- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a0146680 msgr2=0x7fc4a0145ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a0146680 0x7fc4a0145ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 -- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4a00b7660 msgr2=0x7fc4a0145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4a00b7660 0x7fc4a0145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 -- 172.21.15.103:0/4240231420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a0140160 con 0x7fc4a0140f20 2024-04-25T10:33:36.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49effd640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4a00b7660 0x7fc4a0145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:36.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc49e7fc640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4a0140f20 0x7fc4a013f510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4940098c0 tx=0x7fc4940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4877fe640 1 -- 172.21.15.103:0/4240231420 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494042020 con 0x7fc4a0140f20 2024-04-25T10:33:36.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4877fe640 1 -- 172.21.15.103:0/4240231420 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc494003810 con 0x7fc4a0140f20 2024-04-25T10:33:36.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4877fe640 1 -- 172.21.15.103:0/4240231420 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494037040 con 0x7fc4a0140f20 2024-04-25T10:33:36.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a01e0070 con 0x7fc4a0140f20 2024-04-25T10:33:36.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.785+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a0147120 con 0x7fc4a0140f20 2024-04-25T10:33:36.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.786+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a00008d0 con 0x7fc4a0140f20 2024-04-25T10:33:36.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.787+0000 7fc4877fe640 1 -- 172.21.15.103:0/4240231420 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc494045020 con 0x7fc4a0140f20 2024-04-25T10:33:36.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.787+0000 7fc4877fe640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc48c0744e0 0x7fc48c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:36.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.787+0000 7fc49effd640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc48c0744e0 0x7fc48c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:36.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.787+0000 7fc4877fe640 1 -- 172.21.15.103:0/4240231420 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fc4940b5420 con 0x7fc4a0140f20 2024-04-25T10:33:36.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.788+0000 7fc49effd640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc48c0744e0 0x7fc48c0769f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc490005c00 tx=0x7fc490009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:36.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:36.792+0000 7fc4877fe640 1 -- 172.21.15.103:0/4240231420 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc49404c030 con 0x7fc4a0140f20 2024-04-25T10:33:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.005+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4a006a130 con 0x7fc4a0140f20 2024-04-25T10:33:37.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.006+0000 7fc4877fe640 1 -- 172.21.15.103:0/4240231420 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fc49407ff00 con 0x7fc4a0140f20 2024-04-25T10:33:37.007 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:37.007 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/2389441335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2389441335},{"type":"v1","addr":"172.21.15.103:6835","nonce":2389441335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T10:33:37.008 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 2 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc48c0744e0 msgr2=0x7fc48c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc48c0744e0 0x7fc48c0769f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc490005c00 tx=0x7fc490009040 comp rx=0 tx=0).stop 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4a0140f20 msgr2=0x7fc4a013f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4a0140f20 0x7fc4a013f510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4940098c0 tx=0x7fc4940046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 shutdown_connections 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc48c0744e0 0x7fc48c0769f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc4a0146680 0x7fc4a0145ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4a0140f20 0x7fc4a013f510 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 --2- 172.21.15.103:0/4240231420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4a00b7660 0x7fc4a0145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 >> 172.21.15.103:0/4240231420 conn(0x7fc4a006e700 msgr2=0x7fc4a00684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 shutdown_connections 2024-04-25T10:33:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:37.008+0000 7fc4a52a7640 1 -- 172.21.15.103:0/4240231420 wait complete. 2024-04-25T10:33:39.021 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:33:39.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.141+0000 7f8732213640 1 Processor -- start 2024-04-25T10:33:39.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.141+0000 7f8732213640 1 -- start start 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f8732213640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f872c09ddc0 0x7f872c0ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f8732213640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c149550 0x7f872c149960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f8732213640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872c0b5790 con 0x7f872c09c200 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f8732213640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f872c14a2b0 con 0x7f872c09ddc0 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f8732213640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f872c09d190 con 0x7f872c149550 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f872c09c200 0x7f872c09d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51896/0 (socket says 172.21.15.103:51896) 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872b7fe640 1 -- 172.21.15.103:0/2106724547 learned_addr learned my addr 172.21.15.103:0/2106724547 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786458054 0 0) 0x7f872c0b5790 con 0x7f872c09c200 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8714003520 con 0x7f872c09c200 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872bfff640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c149550 0x7f872c149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872affd640 1 --2- 172.21.15.103:0/2106724547 >> v2:172.21.15.132:3300/0 conn(0x7f872c09ddc0 0x7f872c0ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3849668384 0 0) 0x7f8714003520 con 0x7f872c09c200 2024-04-25T10:33:39.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c149550 msgr2=0x7f872c149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c149550 0x7f872c149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 >> v2:172.21.15.132:3300/0 conn(0x7f872c09ddc0 msgr2=0x7f872c0ba9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 --2- 172.21.15.103:0/2106724547 >> v2:172.21.15.132:3300/0 conn(0x7f872c09ddc0 0x7f872c0ba9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872c149ea0 con 0x7f872c09c200 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f8720001670 con 0x7f872c09c200 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872affd640 1 --2- 172.21.15.103:0/2106724547 >> v2:172.21.15.132:3300/0 conn(0x7f872c09ddc0 0x7f872c0ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.142+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 >> v1:172.21.15.103:6789/0 conn(0x7f872c09c200 legacy=0x7f872c09d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872a7fc640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87140039b0 0x7f8714003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872a7fc640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8714004800 0x7f8714004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872a7fc640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c149550 0x7f87140052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f872c14a2b0 con 0x7f8714004800 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f872c09d190 con 0x7f87140039b0 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f871400bba0 con 0x7f872c149550 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872affd640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8714004800 0x7f8714004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872b7fe640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87140039b0 0x7f8714003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872bfff640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c149550 0x7f87140052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872affd640 1 -- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c149550 msgr2=0x7f87140052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872affd640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c149550 0x7f87140052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872affd640 1 -- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87140039b0 msgr2=0x7f8714003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872affd640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87140039b0 0x7f8714003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.143+0000 7f872affd640 1 -- 172.21.15.103:0/2106724547 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8714003520 con 0x7f8714004800 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.144+0000 7f872affd640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8714004800 0x7f8714004c10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f871c0098a0 tx=0x7f8714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1741c177df02ae32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.144+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c00f040 con 0x7f8714004800 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.144+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c02ad20 con 0x7f8714004800 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.144+0000 7f872a7fc640 1 -- 172.21.15.103:0/2106724547 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c004250 con 0x7f8714004800 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.144+0000 7f8732213640 1 -- 172.21.15.103:0/2106724547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8714004800 msgr2=0x7f8714004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.144+0000 7f8732213640 1 --2- 172.21.15.103:0/2106724547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8714004800 0x7f8714004c10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f871c0098a0 tx=0x7f8714005830 comp rx=0 tx=0).stop 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.144+0000 7f872bfff640 1 -- 172.21.15.103:0/2106724547 reap_dead start 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.144+0000 7f8732213640 1 -- 172.21.15.103:0/2106724547 shutdown_connections 2024-04-25T10:33:39.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.145+0000 7f8732213640 1 -- 172.21.15.103:0/2106724547 >> 172.21.15.103:0/2106724547 conn(0x7f872c0bb5d0 msgr2=0x7f872c0bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:39.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.145+0000 7f8732213640 1 -- 172.21.15.103:0/2106724547 shutdown_connections 2024-04-25T10:33:39.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.145+0000 7f8732213640 1 -- 172.21.15.103:0/2106724547 wait complete. 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.146+0000 7f8732213640 1 Processor -- start 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.146+0000 7f8732213640 1 -- start start 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f8732213640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8714004800 0x7f872c0b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f8732213640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c14a7d0 0x7f872c0a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f8732213640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c0a18c0 0x7f872c1e2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f8732213640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f872c151e80 con 0x7f872c14a7d0 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f8732213640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f872c149bf0 con 0x7f8714004800 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f8732213640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f872c152000 con 0x7f872c0a18c0 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f872affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c14a7d0 0x7f872c0a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f872affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c14a7d0 0x7f872c0a2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38962/0 (socket says 172.21.15.103:38962) 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.147+0000 7f872affd640 1 -- 172.21.15.103:0/3293479528 learned_addr learned my addr 172.21.15.103:0/3293479528 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f872bfff640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c0a18c0 0x7f872c1e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f872affd640 1 -- 172.21.15.103:0/3293479528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c0a18c0 msgr2=0x7f872c1e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f872affd640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c0a18c0 0x7f872c1e2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f872affd640 1 -- 172.21.15.103:0/3293479528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8714004800 msgr2=0x7f872c0b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f872affd640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8714004800 0x7f872c0b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f872affd640 1 -- 172.21.15.103:0/3293479528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872c0a33a0 con 0x7f872c14a7d0 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f872affd640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c14a7d0 0x7f872c0a2e60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f871c0099c0 tx=0x7f871c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f8713fff640 1 -- 172.21.15.103:0/3293479528 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c041070 con 0x7f872c14a7d0 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f8713fff640 1 -- 172.21.15.103:0/3293479528 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c00f000 con 0x7f872c14a7d0 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872c0b1c50 con 0x7f872c14a7d0 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f8713fff640 1 -- 172.21.15.103:0/3293479528 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c003c50 con 0x7f872c14a7d0 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.148+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f872c14afd0 con 0x7f872c14a7d0 2024-04-25T10:33:39.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.149+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f872c14b210 con 0x7f872c14a7d0 2024-04-25T10:33:39.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.150+0000 7f8713fff640 1 -- 172.21.15.103:0/3293479528 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f871c044070 con 0x7f872c14a7d0 2024-04-25T10:33:39.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.150+0000 7f8713fff640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f87180744b0 0x7f87180769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.150+0000 7f8713fff640 1 -- 172.21.15.103:0/3293479528 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f871c0b56b0 con 0x7f872c14a7d0 2024-04-25T10:33:39.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.150+0000 7f872b7fe640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f87180744b0 0x7f87180769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.151+0000 7f872b7fe640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f87180744b0 0x7f87180769c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8720001eb0 tx=0x7f8720000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.155+0000 7f8713fff640 1 -- 172.21.15.103:0/3293479528 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f871c080190 con 0x7f872c14a7d0 2024-04-25T10:33:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.367+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f872c06a130 con 0x7f872c14a7d0 2024-04-25T10:33:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.368+0000 7f8713fff640 1 -- 172.21.15.103:0/3293479528 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2219 (secure 0 0 0) 0x7f871c07fa90 con 0x7f872c14a7d0 2024-04-25T10:33:39.370 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:39.370 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/617098639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":617098639},{"type":"v1","addr":"172.21.15.132:6833","nonce":617098639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/2389441335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2389441335},{"type":"v1","addr":"172.21.15.103:6835","nonce":2389441335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T10:33:39.370 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 3 2024-04-25T10:33:39.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.369+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f87180744b0 msgr2=0x7f87180769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.369+0000 7f8732213640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f87180744b0 0x7f87180769c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8720001eb0 tx=0x7f8720000ed0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.369+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c14a7d0 msgr2=0x7f872c0a2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.369+0000 7f8732213640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c14a7d0 0x7f872c0a2e60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f871c0099c0 tx=0x7f871c004730 comp rx=0 tx=0).stop 2024-04-25T10:33:39.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.370+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 shutdown_connections 2024-04-25T10:33:39.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.370+0000 7f8732213640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f87180744b0 0x7f87180769c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.370+0000 7f8732213640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f872c0a18c0 0x7f872c1e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.370+0000 7f8732213640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f872c14a7d0 0x7f872c0a2e60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.370+0000 7f8732213640 1 --2- 172.21.15.103:0/3293479528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8714004800 0x7f872c0b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.370+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 >> 172.21.15.103:0/3293479528 conn(0x7f872c0bb5d0 msgr2=0x7f872c0bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:39.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.370+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 shutdown_connections 2024-04-25T10:33:39.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.370+0000 7f8732213640 1 -- 172.21.15.103:0/3293479528 wait complete. 2024-04-25T10:33:39.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:39.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.489+0000 7fd06d0ee640 1 Processor -- start 2024-04-25T10:33:39.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.489+0000 7fd06d0ee640 1 -- start start 2024-04-25T10:33:39.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd06d0ee640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd06809c200 0x7fd0680ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd06d0ee640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 0x7fd06809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd06d0ee640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0680b5790 con 0x7fd068149550 2024-04-25T10:33:39.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd06d0ee640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd06814a070 con 0x7fd06809c200 2024-04-25T10:33:39.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd06d0ee640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fd06814a2b0 con 0x7fd06809d6b0 2024-04-25T10:33:39.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd066d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd06809c200 0x7fd0680ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd06759e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd068149550 0x7fd068149960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51908/0 (socket says 172.21.15.103:51908) 2024-04-25T10:33:39.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd06759e640 1 -- 172.21.15.103:0/3201413320 learned_addr learned my addr 172.21.15.103:0/3201413320 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:39.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd05ffff640 1 --2- 172.21.15.103:0/3201413320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 0x7fd06809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd066d9d640 1 -- 172.21.15.103:0/3201413320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 msgr2=0x7fd06809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:39.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd066d9d640 1 --2- 172.21.15.103:0/3201413320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 0x7fd06809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd066d9d640 1 -- 172.21.15.103:0/3201413320 >> v1:172.21.15.103:6789/0 conn(0x7fd068149550 legacy=0x7fd068149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd066d9d640 1 -- 172.21.15.103:0/3201413320 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06809d190 con 0x7fd06809c200 2024-04-25T10:33:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.490+0000 7fd06659c640 1 -- 172.21.15.103:0/3201413320 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2196031280 0 0) 0x7fd0680b5790 con 0x7fd068149550 2024-04-25T10:33:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.491+0000 7fd066d9d640 1 --2- 172.21.15.103:0/3201413320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0680ba9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd0580097a0 tx=0x7fd05802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c94f1157a9ed62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.491+0000 7fd06659c640 1 -- 172.21.15.103:0/3201413320 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058037070 con 0x7fd06809c200 2024-04-25T10:33:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.491+0000 7fd06659c640 1 -- 172.21.15.103:0/3201413320 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05802ae50 con 0x7fd06809c200 2024-04-25T10:33:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.491+0000 7fd06659c640 1 -- 172.21.15.103:0/3201413320 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058032660 con 0x7fd06809c200 2024-04-25T10:33:39.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.492+0000 7fd06d0ee640 1 -- 172.21.15.103:0/3201413320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 msgr2=0x7fd0680ba9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.492+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/3201413320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0680ba9d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd0580097a0 tx=0x7fd05802a100 comp rx=0 tx=0).stop 2024-04-25T10:33:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.492+0000 7fd06d0ee640 1 -- 172.21.15.103:0/3201413320 shutdown_connections 2024-04-25T10:33:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.492+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/3201413320 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 0x7fd06809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.492+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/3201413320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0680ba9d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.492+0000 7fd06d0ee640 1 -- 172.21.15.103:0/3201413320 >> 172.21.15.103:0/3201413320 conn(0x7fd0680bb5d0 msgr2=0x7fd0680bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.492+0000 7fd06d0ee640 1 -- 172.21.15.103:0/3201413320 shutdown_connections 2024-04-25T10:33:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.492+0000 7fd06d0ee640 1 -- 172.21.15.103:0/3201413320 wait complete. 2024-04-25T10:33:39.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.494+0000 7fd06d0ee640 1 Processor -- start 2024-04-25T10:33:39.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.494+0000 7fd06d0ee640 1 -- start start 2024-04-25T10:33:39.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06d0ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0681d9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06d0ee640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 0x7fd0680a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06d0ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd068149550 0x7fd06814cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06d0ee640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd068154010 con 0x7fd06809c200 2024-04-25T10:33:39.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06d0ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd068153e90 con 0x7fd068149550 2024-04-25T10:33:39.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06d0ee640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fd068154190 con 0x7fd06809d6b0 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0681d9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0681d9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38976/0 (socket says 172.21.15.103:38976) 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 -- 172.21.15.103:0/1249873691 learned_addr learned my addr 172.21.15.103:0/1249873691 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd05ffff640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 0x7fd0680a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06759e640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd068149550 0x7fd06814cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 -- 172.21.15.103:0/1249873691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 msgr2=0x7fd0680a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 0x7fd0680a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 -- 172.21.15.103:0/1249873691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd068149550 msgr2=0x7fd06814cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd068149550 0x7fd06814cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 -- 172.21.15.103:0/1249873691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0681e2fc0 con 0x7fd06809c200 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd066d9d640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0681d9020 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd058035040 tx=0x7fd0580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd05f7fe640 1 -- 172.21.15.103:0/1249873691 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058037040 con 0x7fd06809c200 2024-04-25T10:33:39.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd05f7fe640 1 -- 172.21.15.103:0/1249873691 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd058004030 con 0x7fd06809c200 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0681e32a0 con 0x7fd06809c200 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd05f7fe640 1 -- 172.21.15.103:0/1249873691 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058004420 con 0x7fd06809c200 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.495+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0680b4e70 con 0x7fd06809c200 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.496+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06806a130 con 0x7fd06809c200 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.497+0000 7fd05f7fe640 1 -- 172.21.15.103:0/1249873691 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd058003610 con 0x7fd06809c200 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.498+0000 7fd05f7fe640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd0480744e0 0x7fd0480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.498+0000 7fd05ffff640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd0480744e0 0x7fd0480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.498+0000 7fd05f7fe640 1 -- 172.21.15.103:0/1249873691 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd0580b5c50 con 0x7fd06809c200 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.498+0000 7fd05ffff640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd0480744e0 0x7fd0480769f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd068153e60 tx=0x7fd050008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.502+0000 7fd05f7fe640 1 -- 172.21.15.103:0/1249873691 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0580bb020 con 0x7fd06809c200 2024-04-25T10:33:39.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.677+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd06809dde0 con 0x7fd06809c200 2024-04-25T10:33:39.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.678+0000 7fd05f7fe640 1 -- 172.21.15.103:0/1249873691 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12944 (secure 0 0 0) 0x7fd058080730 con 0x7fd06809c200 2024-04-25T10:33:39.680 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:39.680 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:32.632156+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:39.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd0480744e0 msgr2=0x7fd0480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd0480744e0 0x7fd0480769f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd068153e60 tx=0x7fd050008040 comp rx=0 tx=0).stop 2024-04-25T10:33:39.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 msgr2=0x7fd0681d9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0681d9020 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd058035040 tx=0x7fd0580046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 shutdown_connections 2024-04-25T10:33:39.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd0480744e0 0x7fd0480769f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd068149550 0x7fd06814cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd06809d6b0 0x7fd0680a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 --2- 172.21.15.103:0/1249873691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd06809c200 0x7fd0681d9020 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 >> 172.21.15.103:0/1249873691 conn(0x7fd0680bb5d0 msgr2=0x7fd0680bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:39.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 shutdown_connections 2024-04-25T10:33:39.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.680+0000 7fd06d0ee640 1 -- 172.21.15.103:0/1249873691 wait complete. 2024-04-25T10:33:39.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:33:30.507871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:33:39.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:33:39.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.802+0000 7f347bdb4640 1 Processor -- start 2024-04-25T10:33:39.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.802+0000 7f347bdb4640 1 -- start start 2024-04-25T10:33:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.803+0000 7f347bdb4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f347409d820 0x7f34740bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.803+0000 7f347bdb4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f347406d6d0 0x7f3474149640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.803+0000 7f347bdb4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34740b9a30 con 0x7f347406dae0 2024-04-25T10:33:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.803+0000 7f347bdb4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f34740b9d10 con 0x7f347406d6d0 2024-04-25T10:33:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.803+0000 7f347bdb4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f34740b9ff0 con 0x7f347409d820 2024-04-25T10:33:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.803+0000 7f347934f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f347406d6d0 0x7f3474149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.803+0000 7f347934f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f347406d6d0 0x7f3474149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38982/0 (socket says 172.21.15.103:38982) 2024-04-25T10:33:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.803+0000 7f347934f640 1 -- 172.21.15.103:0/560663323 learned_addr learned my addr 172.21.15.103:0/560663323 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.804+0000 7f347934f640 1 -- 172.21.15.103:0/560663323 >> v2:172.21.15.132:3300/0 conn(0x7f347409d820 msgr2=0x7f34740bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.804+0000 7f347934f640 1 --2- 172.21.15.103:0/560663323 >> v2:172.21.15.132:3300/0 conn(0x7f347409d820 0x7f34740bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.804+0000 7f347934f640 1 -- 172.21.15.103:0/560663323 >> v1:172.21.15.132:6789/0 conn(0x7f347406dae0 legacy=0x7f347414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:39.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.804+0000 7f347934f640 1 -- 172.21.15.103:0/560663323 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347409dc30 con 0x7f347406d6d0 2024-04-25T10:33:39.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.804+0000 7f347934f640 1 --2- 172.21.15.103:0/560663323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406d6d0 0x7f3474149640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f347408cf30 tx=0x7f346402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21d6872a8f62033 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.804+0000 7f3478b4e640 1 -- 172.21.15.103:0/560663323 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464037070 con 0x7f347406d6d0 2024-04-25T10:33:39.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.804+0000 7f3478b4e640 1 -- 172.21.15.103:0/560663323 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3464032440 con 0x7f347406d6d0 2024-04-25T10:33:39.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.804+0000 7f3478b4e640 1 -- 172.21.15.103:0/560663323 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464032810 con 0x7f347406d6d0 2024-04-25T10:33:39.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.805+0000 7f347bdb4640 1 -- 172.21.15.103:0/560663323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406d6d0 msgr2=0x7f3474149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.805+0000 7f347bdb4640 1 --2- 172.21.15.103:0/560663323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406d6d0 0x7f3474149640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f347408cf30 tx=0x7f346402a1a0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.805+0000 7f347bdb4640 1 -- 172.21.15.103:0/560663323 shutdown_connections 2024-04-25T10:33:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.805+0000 7f347bdb4640 1 --2- 172.21.15.103:0/560663323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406d6d0 0x7f3474149640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.805+0000 7f347bdb4640 1 --2- 172.21.15.103:0/560663323 >> v2:172.21.15.132:3300/0 conn(0x7f347409d820 0x7f34740bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.805+0000 7f347bdb4640 1 -- 172.21.15.103:0/560663323 >> 172.21.15.103:0/560663323 conn(0x7f34740bee10 msgr2=0x7f34740bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.805+0000 7f347bdb4640 1 -- 172.21.15.103:0/560663323 shutdown_connections 2024-04-25T10:33:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.805+0000 7f347bdb4640 1 -- 172.21.15.103:0/560663323 wait complete. 2024-04-25T10:33:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.807+0000 7f347bdb4640 1 Processor -- start 2024-04-25T10:33:39.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.807+0000 7f347bdb4640 1 -- start start 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347bdb4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f347406d6d0 0x7f347414a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347bdb4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406dae0 0x7f347414cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347bdb4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f347409d820 0x7f347414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347bdb4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f34740ba690 con 0x7f347406dae0 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347bdb4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f34740ba510 con 0x7f347409d820 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347bdb4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f34740b94c0 con 0x7f347406d6d0 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406dae0 0x7f347414cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406dae0 0x7f347414cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38996/0 (socket says 172.21.15.103:38996) 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 -- 172.21.15.103:0/1184416731 learned_addr learned my addr 172.21.15.103:0/1184416731 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347a351640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f347409d820 0x7f347414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 -- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f347406d6d0 msgr2=0x7f347414a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f3479b50640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f347406d6d0 0x7f347414a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f347406d6d0 0x7f347414a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 -- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f347409d820 msgr2=0x7f347414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f347409d820 0x7f347414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 -- 172.21.15.103:0/1184416731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34741e3430 con 0x7f347406dae0 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347a351640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f347409d820 0x7f347414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347934f640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406dae0 0x7f347414cea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3464000c00 tx=0x7f34640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f346a7fc640 1 -- 172.21.15.103:0/1184416731 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464041070 con 0x7f347406dae0 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f346a7fc640 1 -- 172.21.15.103:0/1184416731 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346403c870 con 0x7f347406dae0 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f346a7fc640 1 -- 172.21.15.103:0/1184416731 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464037040 con 0x7f347406dae0 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34741e3710 con 0x7f347406dae0 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.808+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34740b61d0 con 0x7f347406dae0 2024-04-25T10:33:39.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.809+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34740b8a90 con 0x7f347406dae0 2024-04-25T10:33:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.810+0000 7f346a7fc640 1 -- 172.21.15.103:0/1184416731 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f3464044070 con 0x7f347406dae0 2024-04-25T10:33:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.811+0000 7f346a7fc640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f34580744b0 0x7f34580769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.811+0000 7f346a7fc640 1 -- 172.21.15.103:0/1184416731 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f34640b59e0 con 0x7f347406dae0 2024-04-25T10:33:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.811+0000 7f3479b50640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f34580744b0 0x7f34580769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:39.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.811+0000 7f3479b50640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f34580744b0 0x7f34580769c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f347000a770 tx=0x7f3470008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:39.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.815+0000 7f346a7fc640 1 -- 172.21.15.103:0/1184416731 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f34640805e0 con 0x7f347406dae0 2024-04-25T10:33:39.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.992+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3474069b70 con 0x7f347406dae0 2024-04-25T10:33:39.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.992+0000 7f346a7fc640 1 -- 172.21.15.103:0/1184416731 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f3474069b70 con 0x7f347406dae0 2024-04-25T10:33:39.994 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-04-25T10:33:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f34580744b0 msgr2=0x7f34580769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f34580744b0 0x7f34580769c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f347000a770 tx=0x7f3470008040 comp rx=0 tx=0).stop 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406dae0 msgr2=0x7f347414cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406dae0 0x7f347414cea0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3464000c00 tx=0x7f34640046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 shutdown_connections 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f34580744b0 0x7f34580769c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f347409d820 0x7f347414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f347406dae0 0x7f347414cea0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 --2- 172.21.15.103:0/1184416731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f347406d6d0 0x7f347414a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.994+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 >> 172.21.15.103:0/1184416731 conn(0x7f34740bee10 msgr2=0x7f34740bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.995+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 shutdown_connections 2024-04-25T10:33:39.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:39.995+0000 7f347bdb4640 1 -- 172.21.15.103:0/1184416731 wait complete. 2024-04-25T10:33:40.007 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:33:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.112+0000 7ff2ccf57640 1 Processor -- start 2024-04-25T10:33:40.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.112+0000 7ff2ccf57640 1 -- start start 2024-04-25T10:33:40.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.113+0000 7ff2ccf57640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2c8149ca0 0x7ff2c814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.113+0000 7ff2ccf57640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c814a5f0 con 0x7ff2c8151f00 2024-04-25T10:33:40.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.113+0000 7ff2ccf57640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2c806d5a0 con 0x7ff2c8068bd0 2024-04-25T10:33:40.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.113+0000 7ff2ccf57640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c806ce60 con 0x7ff2c8149ca0 2024-04-25T10:33:40.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c6d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff2c8151f00 0x7ff2c8154320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51922/0 (socket says 172.21.15.103:51922) 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c6d9d640 1 -- 172.21.15.103:0/2643747967 learned_addr learned my addr 172.21.15.103:0/2643747967 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c5d9b640 1 --2- 172.21.15.103:0/2643747967 >> v2:172.21.15.132:3300/0 conn(0x7ff2c8149ca0 0x7ff2c814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157415753 0 0) 0x7ff2c0001110 con 0x7ff2c8151f00 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2b0003520 con 0x7ff2c8151f00 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1238822482 0 0) 0x7ff2b0003520 con 0x7ff2c8151f00 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 >> v2:172.21.15.132:3300/0 conn(0x7ff2c8149ca0 msgr2=0x7ff2c814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 --2- 172.21.15.103:0/2643747967 >> v2:172.21.15.132:3300/0 conn(0x7ff2c8149ca0 0x7ff2c814a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 >> v1:172.21.15.132:6789/0 conn(0x7ff2c8068bd0 legacy=0x7ff2c80b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c806d880 con 0x7ff2c8151f00 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7ff2c0001840 con 0x7ff2c8151f00 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 >> v1:172.21.15.103:6789/0 conn(0x7ff2c8151f00 legacy=0x7ff2c8154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b00039b0 0x7ff2b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b0004800 0x7ff2b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b00051c0 0x7ff2b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c806ce60 con 0x7ff2b0004800 2024-04-25T10:33:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b000c160 con 0x7ff2b00039b0 2024-04-25T10:33:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b000c360 con 0x7ff2b00051c0 2024-04-25T10:33:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.114+0000 7ff2c5d9b640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b0004800 0x7ff2b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c659c640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b00039b0 0x7ff2b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c6d9d640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b00051c0 0x7ff2b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c5d9b640 1 -- 172.21.15.103:0/2643747967 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b00051c0 msgr2=0x7ff2b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c5d9b640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b00051c0 0x7ff2b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c5d9b640 1 -- 172.21.15.103:0/2643747967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b00039b0 msgr2=0x7ff2b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c5d9b640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2b00039b0 0x7ff2b0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c6d9d640 1 -- 172.21.15.103:0/2643747967 reap_dead start 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c5d9b640 1 -- 172.21.15.103:0/2643747967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b0003520 con 0x7ff2b0004800 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.115+0000 7ff2c5d9b640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b0004800 0x7ff2b0004c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2c809e170 tx=0x7ff2b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24b6bf4820e05d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc036070 con 0x7ff2b0004800 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc031400 con 0x7ff2b0004800 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2c559a640 1 -- 172.21.15.103:0/2643747967 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc009690 con 0x7ff2b0004800 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2ccf57640 1 -- 172.21.15.103:0/2643747967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b0004800 msgr2=0x7ff2b0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2ccf57640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b0004800 0x7ff2b0004c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2c809e170 tx=0x7ff2b0005830 comp rx=0 tx=0).stop 2024-04-25T10:33:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2ccf57640 1 -- 172.21.15.103:0/2643747967 shutdown_connections 2024-04-25T10:33:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2ccf57640 1 --2- 172.21.15.103:0/2643747967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2b0004800 0x7ff2b0004c10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2ccf57640 1 -- 172.21.15.103:0/2643747967 >> 172.21.15.103:0/2643747967 conn(0x7ff2c80a0100 msgr2=0x7ff2c80a0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2ccf57640 1 -- 172.21.15.103:0/2643747967 shutdown_connections 2024-04-25T10:33:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.116+0000 7ff2ccf57640 1 -- 172.21.15.103:0/2643747967 wait complete. 2024-04-25T10:33:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.118+0000 7ff2ccf57640 1 Processor -- start 2024-04-25T10:33:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.118+0000 7ff2ccf57640 1 -- start start 2024-04-25T10:33:40.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2ccf57640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b0004800 0x7ff2c809c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2ccf57640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c81df9d0 0x7ff2c8140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2ccf57640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2c813dbe0 0x7ff2c813dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2ccf57640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c8068fe0 con 0x7ff2c81df9d0 2024-04-25T10:33:40.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2ccf57640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c806c9d0 con 0x7ff2c813dbe0 2024-04-25T10:33:40.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2ccf57640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c806c660 con 0x7ff2b0004800 2024-04-25T10:33:40.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c81df9d0 0x7ff2c8140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c81df9d0 0x7ff2c8140cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39016/0 (socket says 172.21.15.103:39016) 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c5d9b640 1 -- 172.21.15.103:0/4024099052 learned_addr learned my addr 172.21.15.103:0/4024099052 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c659c640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b0004800 0x7ff2c809c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c6d9d640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2c813dbe0 0x7ff2c813dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c5d9b640 1 -- 172.21.15.103:0/4024099052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b0004800 msgr2=0x7ff2c809c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c5d9b640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b0004800 0x7ff2c809c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c5d9b640 1 -- 172.21.15.103:0/4024099052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2c813dbe0 msgr2=0x7ff2c813dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c5d9b640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2c813dbe0 0x7ff2c813dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.119+0000 7ff2c5d9b640 1 -- 172.21.15.103:0/4024099052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c813e530 con 0x7ff2c81df9d0 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.120+0000 7ff2c5d9b640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c81df9d0 0x7ff2c8140cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009b80 tx=0x7ff2bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.120+0000 7ff2b6ffd640 1 -- 172.21.15.103:0/4024099052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc040030 con 0x7ff2c81df9d0 2024-04-25T10:33:40.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.120+0000 7ff2b6ffd640 1 -- 172.21.15.103:0/4024099052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2bc03b460 con 0x7ff2c81df9d0 2024-04-25T10:33:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.120+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c81411f0 con 0x7ff2c81df9d0 2024-04-25T10:33:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.120+0000 7ff2b6ffd640 1 -- 172.21.15.103:0/4024099052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc036040 con 0x7ff2c81df9d0 2024-04-25T10:33:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.120+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c81e01d0 con 0x7ff2c81df9d0 2024-04-25T10:33:40.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.121+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c81df7e0 con 0x7ff2c81df9d0 2024-04-25T10:33:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.121+0000 7ff2b6ffd640 1 -- 172.21.15.103:0/4024099052 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff2bc043070 con 0x7ff2c81df9d0 2024-04-25T10:33:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.122+0000 7ff2b6ffd640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff2a80744b0 0x7ff2a80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.122+0000 7ff2c659c640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff2a80744b0 0x7ff2a80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.122+0000 7ff2b6ffd640 1 -- 172.21.15.103:0/4024099052 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff2bc0b4c70 con 0x7ff2c81df9d0 2024-04-25T10:33:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.122+0000 7ff2c659c640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff2a80744b0 0x7ff2a80769c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8069ea0 tx=0x7ff2b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:40.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.126+0000 7ff2b6ffd640 1 -- 172.21.15.103:0/4024099052 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff2c813e530 con 0x7ff2c81df9d0 2024-04-25T10:33:40.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.302+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff2c806a130 con 0x7ff2c81df9d0 2024-04-25T10:33:40.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.303+0000 7ff2b6ffd640 1 -- 172.21.15.103:0/4024099052 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7ff2bc07f100 con 0x7ff2c81df9d0 2024-04-25T10:33:40.304 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:40.305 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-04-25T10:33:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-04-25T10:33:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-04-25T10:33:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-04-25T10:33:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-04-25T10:33:40.305 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-04-25T10:33:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff2a80744b0 msgr2=0x7ff2a80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff2a80744b0 0x7ff2a80769c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8069ea0 tx=0x7ff2b8009040 comp rx=0 tx=0).stop 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c81df9d0 msgr2=0x7ff2c8140cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c81df9d0 0x7ff2c8140cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009b80 tx=0x7ff2bc004730 comp rx=0 tx=0).stop 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 shutdown_connections 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff2a80744b0 0x7ff2a80769c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2c813dbe0 0x7ff2c813dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2c81df9d0 0x7ff2c8140cb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 --2- 172.21.15.103:0/4024099052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff2b0004800 0x7ff2c809c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 >> 172.21.15.103:0/4024099052 conn(0x7ff2c80a0100 msgr2=0x7ff2c8148f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 shutdown_connections 2024-04-25T10:33:40.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.305+0000 7ff2ccf57640 1 -- 172.21.15.103:0/4024099052 wait complete. 2024-04-25T10:33:40.317 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:33:40.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:33:40.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.428+0000 7f066aa51640 1 Processor -- start 2024-04-25T10:33:40.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.428+0000 7f066aa51640 1 -- start start 2024-04-25T10:33:40.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f066aa51640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0664073860 0x7f066406d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f066aa51640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f06641439e0 0x7f0664153e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f066aa51640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0664074020 con 0x7f06641435d0 2024-04-25T10:33:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f066aa51640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f06640b7050 con 0x7f06641439e0 2024-04-25T10:33:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f066aa51640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f06640b74e0 con 0x7f0664073860 2024-04-25T10:33:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f0663fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0664073860 0x7f066406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f0668fee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f06641439e0 0x7f0664153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f0663fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0664073860 0x7f066406d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:33244/0 (socket says 172.21.15.103:33244) 2024-04-25T10:33:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.429+0000 7f0663fff640 1 -- 172.21.15.103:0/1762083823 learned_addr learned my addr 172.21.15.103:0/1762083823 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.430+0000 7f0663fff640 1 -- 172.21.15.103:0/1762083823 >> v2:172.21.15.132:3300/0 conn(0x7f06641439e0 msgr2=0x7f0664153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.430+0000 7f0663fff640 1 --2- 172.21.15.103:0/1762083823 >> v2:172.21.15.132:3300/0 conn(0x7f06641439e0 0x7f0664153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.430+0000 7f0663fff640 1 -- 172.21.15.103:0/1762083823 >> v1:172.21.15.132:6789/0 conn(0x7f06641435d0 legacy=0x7f0664149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.430+0000 7f0663fff640 1 -- 172.21.15.103:0/1762083823 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0664073d40 con 0x7f0664073860 2024-04-25T10:33:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.430+0000 7f0663fff640 1 --2- 172.21.15.103:0/1762083823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0664073860 0x7f066406d030 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06640b71d0 tx=0x7f065402a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710ba799a423bb12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f0662ffd640 1 -- 172.21.15.103:0/1762083823 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654037070 con 0x7f0664073860 2024-04-25T10:33:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f0662ffd640 1 -- 172.21.15.103:0/1762083823 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0654032440 con 0x7f0664073860 2024-04-25T10:33:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f0662ffd640 1 -- 172.21.15.103:0/1762083823 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654032810 con 0x7f0664073860 2024-04-25T10:33:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f066aa51640 1 -- 172.21.15.103:0/1762083823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0664073860 msgr2=0x7f066406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f066aa51640 1 --2- 172.21.15.103:0/1762083823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0664073860 0x7f066406d030 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06640b71d0 tx=0x7f065402a1e0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f066aa51640 1 -- 172.21.15.103:0/1762083823 shutdown_connections 2024-04-25T10:33:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f066aa51640 1 --2- 172.21.15.103:0/1762083823 >> v2:172.21.15.132:3300/0 conn(0x7f06641439e0 0x7f0664153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f066aa51640 1 --2- 172.21.15.103:0/1762083823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0664073860 0x7f066406d030 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f066aa51640 1 -- 172.21.15.103:0/1762083823 >> 172.21.15.103:0/1762083823 conn(0x7f066406e750 msgr2=0x7f06640bb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f066aa51640 1 -- 172.21.15.103:0/1762083823 shutdown_connections 2024-04-25T10:33:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.431+0000 7f066aa51640 1 -- 172.21.15.103:0/1762083823 wait complete. 2024-04-25T10:33:40.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.433+0000 7f066aa51640 1 Processor -- start 2024-04-25T10:33:40.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.433+0000 7f066aa51640 1 -- start start 2024-04-25T10:33:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f066aa51640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0664073860 0x7f06641445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f066aa51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06641435d0 0x7f0664145580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f066aa51640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06641439e0 0x7f06641df850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f066aa51640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0664149c10 con 0x7f0664073860 2024-04-25T10:33:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f066aa51640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f06640b6280 con 0x7f06641435d0 2024-04-25T10:33:40.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f066aa51640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f0664074290 con 0x7f06641439e0 2024-04-25T10:33:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f0663fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0664073860 0x7f06641445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f0663fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0664073860 0x7f06641445a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39018/0 (socket says 172.21.15.103:39018) 2024-04-25T10:33:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f0663fff640 1 -- 172.21.15.103:0/2794649876 learned_addr learned my addr 172.21.15.103:0/2794649876 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f06637fe640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06641435d0 0x7f0664145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.434+0000 7f0668fee640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06641439e0 0x7f06641df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0663fff640 1 -- 172.21.15.103:0/2794649876 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06641439e0 msgr2=0x7f06641df850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0663fff640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06641439e0 0x7f06641df850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0663fff640 1 -- 172.21.15.103:0/2794649876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06641435d0 msgr2=0x7f0664145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0663fff640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06641435d0 0x7f0664145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0663fff640 1 -- 172.21.15.103:0/2794649876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0664146680 con 0x7f0664073860 2024-04-25T10:33:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0663fff640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0664073860 0x7f06641445a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f06540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0660ff9640 1 -- 172.21.15.103:0/2794649876 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654041070 con 0x7f0664073860 2024-04-25T10:33:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0660ff9640 1 -- 172.21.15.103:0/2794649876 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065403c870 con 0x7f0664073860 2024-04-25T10:33:40.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0664144ae0 con 0x7f0664073860 2024-04-25T10:33:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f0660ff9640 1 -- 172.21.15.103:0/2794649876 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654037040 con 0x7f0664073860 2024-04-25T10:33:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.435+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0664144080 con 0x7f0664073860 2024-04-25T10:33:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.436+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f066406a130 con 0x7f0664073860 2024-04-25T10:33:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.437+0000 7f0660ff9640 1 -- 172.21.15.103:0/2794649876 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0654044070 con 0x7f0664073860 2024-04-25T10:33:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.437+0000 7f0660ff9640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06440744e0 0x7f06440769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:40.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.437+0000 7f06637fe640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06440744e0 0x7f06440769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.437+0000 7f0660ff9640 1 -- 172.21.15.103:0/2794649876 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f06540b5760 con 0x7f0664073860 2024-04-25T10:33:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.438+0000 7f06637fe640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06440744e0 0x7f06440769f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06640b9aa0 tx=0x7f064c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:40.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.442+0000 7f0660ff9640 1 -- 172.21.15.103:0/2794649876 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f065407fc80 con 0x7f0664073860 2024-04-25T10:33:40.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:40.621+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f06640bc6c0 con 0x7f0664073860 2024-04-25T10:33:41.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.140+0000 7f0660ff9640 1 -- 172.21.15.103:0/2794649876 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f0654083f80 con 0x7f0664073860 2024-04-25T10:33:41.142 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-04-25T10:33:41.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06440744e0 msgr2=0x7f06440769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:41.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06440744e0 0x7f06440769f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06640b9aa0 tx=0x7f064c009040 comp rx=0 tx=0).stop 2024-04-25T10:33:41.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0664073860 msgr2=0x7f06641445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:41.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0664073860 0x7f06641445a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f06540046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 shutdown_connections 2024-04-25T10:33:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06440744e0 0x7f06440769f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f06641439e0 0x7f06641df850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06641435d0 0x7f0664145580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 --2- 172.21.15.103:0/2794649876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0664073860 0x7f06641445a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.143+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 >> 172.21.15.103:0/2794649876 conn(0x7f066406e750 msgr2=0x7f066406d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.144+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 shutdown_connections 2024-04-25T10:33:41.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.144+0000 7f066aa51640 1 -- 172.21.15.103:0/2794649876 wait complete. 2024-04-25T10:33:41.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:33:41.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.276+0000 7f616580c640 1 Processor -- start 2024-04-25T10:33:41.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.276+0000 7f616580c640 1 -- start start 2024-04-25T10:33:41.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.277+0000 7f616580c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f616006d8d0 0x7f61600bbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:41.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.277+0000 7f616580c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f616006eb90 0x7f6160149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:41.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.277+0000 7f616580c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61600bafc0 con 0x7f61600bab00 2024-04-25T10:33:41.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.277+0000 7f616580c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f616006d3b0 con 0x7f616006d8d0 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.277+0000 7f616580c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f616006efa0 con 0x7f616006eb90 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.277+0000 7f615e7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f616006d8d0 0x7f61600bbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.277+0000 7f615e7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f616006d8d0 0x7f61600bbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39028/0 (socket says 172.21.15.103:39028) 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.277+0000 7f615e7fc640 1 -- 172.21.15.103:0/2151753123 learned_addr learned my addr 172.21.15.103:0/2151753123 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.278+0000 7f615f7fe640 1 --2- 172.21.15.103:0/2151753123 >> v2:172.21.15.132:3300/0 conn(0x7f616006eb90 0x7f6160149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.278+0000 7f615e7fc640 1 -- 172.21.15.103:0/2151753123 >> v2:172.21.15.132:3300/0 conn(0x7f616006eb90 msgr2=0x7f6160149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.278+0000 7f615e7fc640 1 --2- 172.21.15.103:0/2151753123 >> v2:172.21.15.132:3300/0 conn(0x7f616006eb90 0x7f6160149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.278+0000 7f615e7fc640 1 -- 172.21.15.103:0/2151753123 >> v1:172.21.15.132:6789/0 conn(0x7f61600bab00 legacy=0x7f616014cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:41.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.278+0000 7f615e7fc640 1 -- 172.21.15.103:0/2151753123 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616014a430 con 0x7f616006d8d0 2024-04-25T10:33:41.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.278+0000 7f615e7fc640 1 --2- 172.21.15.103:0/2151753123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61600bbd60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f616006dd10 tx=0x7f614802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636ad13565f0468a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:41.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.278+0000 7f615dffb640 1 -- 172.21.15.103:0/2151753123 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148037070 con 0x7f616006d8d0 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f615dffb640 1 -- 172.21.15.103:0/2151753123 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6148032440 con 0x7f616006d8d0 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f615dffb640 1 -- 172.21.15.103:0/2151753123 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148032810 con 0x7f616006d8d0 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f616580c640 1 -- 172.21.15.103:0/2151753123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 msgr2=0x7f61600bbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f616580c640 1 --2- 172.21.15.103:0/2151753123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61600bbd60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f616006dd10 tx=0x7f614802a150 comp rx=0 tx=0).stop 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f616580c640 1 -- 172.21.15.103:0/2151753123 shutdown_connections 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f616580c640 1 --2- 172.21.15.103:0/2151753123 >> v2:172.21.15.132:3300/0 conn(0x7f616006eb90 0x7f6160149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f616580c640 1 --2- 172.21.15.103:0/2151753123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61600bbd60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f616580c640 1 -- 172.21.15.103:0/2151753123 >> 172.21.15.103:0/2151753123 conn(0x7f61600befc0 msgr2=0x7f61600bb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f616580c640 1 -- 172.21.15.103:0/2151753123 shutdown_connections 2024-04-25T10:33:41.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.279+0000 7f616580c640 1 -- 172.21.15.103:0/2151753123 wait complete. 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.281+0000 7f616580c640 1 Processor -- start 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.281+0000 7f616580c640 1 -- start start 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f616580c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61601dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f616580c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616006eb90 0x7f61600a2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f616580c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616013dc00 0x7f616013e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f616580c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f61601541d0 con 0x7f616006d8d0 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f616580c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f616006f150 con 0x7f616013dc00 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f616580c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f6160154350 con 0x7f616006eb90 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61601dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61601dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39040/0 (socket says 172.21.15.103:39040) 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 -- 172.21.15.103:0/976040186 learned_addr learned my addr 172.21.15.103:0/976040186 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:41.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 -- 172.21.15.103:0/976040186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616006eb90 msgr2=0x7f61600a2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616006eb90 0x7f61600a2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615f7fe640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616013dc00 0x7f616013e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 -- 172.21.15.103:0/976040186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616013dc00 msgr2=0x7f616013e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616013dc00 0x7f616013e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 -- 172.21.15.103:0/976040186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61601457c0 con 0x7f616006d8d0 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615f7fe640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616013dc00 0x7f616013e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.282+0000 7f615effd640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61601dfc80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f615000c760 tx=0x7f615000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.283+0000 7f6157fff640 1 -- 172.21.15.103:0/976040186 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150016020 con 0x7f616006d8d0 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.283+0000 7f6157fff640 1 -- 172.21.15.103:0/976040186 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6150006d50 con 0x7f616006d8d0 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.283+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61601e01c0 con 0x7f616006d8d0 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.283+0000 7f6157fff640 1 -- 172.21.15.103:0/976040186 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150003bb0 con 0x7f616006d8d0 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.283+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616013e550 con 0x7f616006d8d0 2024-04-25T10:33:41.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.284+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61601df550 con 0x7f616006d8d0 2024-04-25T10:33:41.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.284+0000 7f6157fff640 1 -- 172.21.15.103:0/976040186 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f615000a850 con 0x7f616006d8d0 2024-04-25T10:33:41.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.285+0000 7f6157fff640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f61400744e0 0x7f61400769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:41.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.285+0000 7f615e7fc640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f61400744e0 0x7f61400769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:41.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.285+0000 7f6157fff640 1 -- 172.21.15.103:0/976040186 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f6150095950 con 0x7f616006d8d0 2024-04-25T10:33:41.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.285+0000 7f615e7fc640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f61400744e0 0x7f61400769f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6148034000 tx=0x7f614802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:41.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.289+0000 7f6157fff640 1 -- 172.21.15.103:0/976040186 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6150020020 con 0x7f616006d8d0 2024-04-25T10:33:41.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:41.464+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6160145a30 con 0x7f616006d8d0 2024-04-25T10:33:42.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.143+0000 7f6157fff640 1 -- 172.21.15.103:0/976040186 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7f61500604c0 con 0x7f616006d8d0 2024-04-25T10:33:42.144 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-04-25T10:33:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.146+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f61400744e0 msgr2=0x7f61400769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.146+0000 7f616580c640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f61400744e0 0x7f61400769f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6148034000 tx=0x7f614802c000 comp rx=0 tx=0).stop 2024-04-25T10:33:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.146+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 msgr2=0x7f61601dfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:42.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.146+0000 7f616580c640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61601dfc80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f615000c760 tx=0x7f615000cc20 comp rx=0 tx=0).stop 2024-04-25T10:33:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.148+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 shutdown_connections 2024-04-25T10:33:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.148+0000 7f616580c640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f61400744e0 0x7f61400769f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.148+0000 7f616580c640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f616013dc00 0x7f616013e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.148+0000 7f616580c640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f616006eb90 0x7f61600a2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.148+0000 7f616580c640 1 --2- 172.21.15.103:0/976040186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f616006d8d0 0x7f61601dfc80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.148+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 >> 172.21.15.103:0/976040186 conn(0x7f61600befc0 msgr2=0x7f61600b9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.151+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 shutdown_connections 2024-04-25T10:33:42.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.153+0000 7f616580c640 1 -- 172.21.15.103:0/976040186 wait complete. 2024-04-25T10:33:42.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:33:42.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.283+0000 7fb96bae0640 1 Processor -- start 2024-04-25T10:33:42.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.284+0000 7fb96bae0640 1 -- start start 2024-04-25T10:33:42.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.284+0000 7fb96bae0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb96414a010 0x7fb96409c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:42.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96bae0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb96409dc00 con 0x7fb96409c740 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96bae0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb96409dee0 con 0x7fb9640a0b80 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96bae0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb9640b57a0 con 0x7fb96414a010 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96a07d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb96409c740 0x7fb964153e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51928/0 (socket says 172.21.15.103:51928) 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96a07d640 1 -- 172.21.15.103:0/1645998581 learned_addr learned my addr 172.21.15.103:0/1645998581 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96907b640 1 --2- 172.21.15.103:0/1645998581 >> v2:172.21.15.132:3300/0 conn(0x7fb96414a010 0x7fb96409c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914997772 0 0) 0x7fb96409dc00 con 0x7fb96409c740 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb950003520 con 0x7fb96409c740 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241586185 0 0) 0x7fb96409dee0 con 0x7fb9640a0b80 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb96409dc00 con 0x7fb9640a0b80 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1025967543 0 0) 0x7fb950003520 con 0x7fb96409c740 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 >> v2:172.21.15.132:3300/0 conn(0x7fb96414a010 msgr2=0x7fb96409c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:42.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 --2- 172.21.15.103:0/1645998581 >> v2:172.21.15.132:3300/0 conn(0x7fb96414a010 0x7fb96409c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 >> v1:172.21.15.132:6789/0 conn(0x7fb9640a0b80 legacy=0x7fb964149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96409cb50 con 0x7fb96409c740 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fb95c001670 con 0x7fb96409c740 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 >> v1:172.21.15.103:6789/0 conn(0x7fb96409c740 legacy=0x7fb964153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb950003b40 0x7fb950003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950004800 0x7fb950004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb950005260 0x7fb95000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb9640b57a0 con 0x7fb950005260 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb95000c1c0 con 0x7fb950003b40 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fb95000c3c0 con 0x7fb950004800 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.285+0000 7fb96a07d640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb950005260 0x7fb95000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:42.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96987c640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb950003b40 0x7fb950003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96907b640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950004800 0x7fb950004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96a07d640 1 -- 172.21.15.103:0/1645998581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950004800 msgr2=0x7fb950004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96a07d640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950004800 0x7fb950004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96a07d640 1 -- 172.21.15.103:0/1645998581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb950003b40 msgr2=0x7fb950003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96a07d640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb950003b40 0x7fb950003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96a07d640 1 -- 172.21.15.103:0/1645998581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb950003520 con 0x7fb950005260 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96a07d640 1 -- 172.21.15.103:0/1645998581 reap_dead start 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.286+0000 7fb96a07d640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb950005260 0x7fb95000b9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c190 tx=0x7fb950005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdf1e7c231a50e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c007cc0 con 0x7fb950005260 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c005ad0 con 0x7fb950005260 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96887a640 1 -- 172.21.15.103:0/1645998581 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c007070 con 0x7fb950005260 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96bae0640 1 -- 172.21.15.103:0/1645998581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb950005260 msgr2=0x7fb95000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96bae0640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb950005260 0x7fb95000b9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c190 tx=0x7fb950005830 comp rx=0 tx=0).stop 2024-04-25T10:33:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96bae0640 1 -- 172.21.15.103:0/1645998581 shutdown_connections 2024-04-25T10:33:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96bae0640 1 --2- 172.21.15.103:0/1645998581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb950005260 0x7fb95000b9c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96bae0640 1 -- 172.21.15.103:0/1645998581 >> 172.21.15.103:0/1645998581 conn(0x7fb9640bb5e0 msgr2=0x7fb9640bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96bae0640 1 -- 172.21.15.103:0/1645998581 shutdown_connections 2024-04-25T10:33:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.287+0000 7fb96bae0640 1 -- 172.21.15.103:0/1645998581 wait complete. 2024-04-25T10:33:42.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.289+0000 7fb96bae0640 1 Processor -- start 2024-04-25T10:33:42.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.289+0000 7fb96bae0640 1 -- start start 2024-04-25T10:33:42.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96bae0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950005260 0x7fb9641df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:42.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96bae0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96414bd90 0x7fb9640b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:42.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96bae0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9641e33e0 0x7fb96414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:42.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96bae0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb96409c200 con 0x7fb9641e33e0 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96bae0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb96409d3b0 con 0x7fb96414bd90 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96bae0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fb96409c380 con 0x7fb950005260 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9641e33e0 0x7fb96414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9641e33e0 0x7fb96414ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39054/0 (socket says 172.21.15.103:39054) 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 -- 172.21.15.103:0/1230549532 learned_addr learned my addr 172.21.15.103:0/1230549532 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96987c640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950005260 0x7fb9641df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96907b640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96414bd90 0x7fb9640b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 -- 172.21.15.103:0/1230549532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950005260 msgr2=0x7fb9641df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950005260 0x7fb9641df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 -- 172.21.15.103:0/1230549532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96414bd90 msgr2=0x7fb9640b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96414bd90 0x7fb9640b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 -- 172.21.15.103:0/1230549532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9641e2940 con 0x7fb9641e33e0 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.290+0000 7fb96a07d640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9641e33e0 0x7fb96414ca80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb95c02ad00 tx=0x7fb95c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.291+0000 7fb95a7fc640 1 -- 172.21.15.103:0/1230549532 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c041070 con 0x7fb9641e33e0 2024-04-25T10:33:42.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.291+0000 7fb95a7fc640 1 -- 172.21.15.103:0/1230549532 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c001680 con 0x7fb9641e33e0 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.291+0000 7fb95a7fc640 1 -- 172.21.15.103:0/1230549532 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c004a00 con 0x7fb9641e33e0 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.291+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9640b4bc0 con 0x7fb9641e33e0 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.291+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9641e2ec0 con 0x7fb9641e33e0 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.292+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96414bb90 con 0x7fb9641e33e0 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.292+0000 7fb95a7fc640 1 -- 172.21.15.103:0/1230549532 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb95c044070 con 0x7fb9641e33e0 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.293+0000 7fb95a7fc640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb9480744b0 0x7fb9480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.293+0000 7fb95a7fc640 1 -- 172.21.15.103:0/1230549532 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fb95c0b44c0 con 0x7fb9641e33e0 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.293+0000 7fb96987c640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb9480744b0 0x7fb9480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:42.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.293+0000 7fb96987c640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb9480744b0 0x7fb9480769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb960000f80 tx=0x7fb960009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:42.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.298+0000 7fb95a7fc640 1 -- 172.21.15.103:0/1230549532 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb96414bb90 con 0x7fb9641e33e0 2024-04-25T10:33:42.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:42.511+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb96406a130 con 0x7fb9641e33e0 2024-04-25T10:33:43.004 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:33:43.007 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:33:43.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.163+0000 7fb95a7fc640 1 -- 172.21.15.103:0/1230549532 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb95c07ed40 con 0x7fb9641e33e0 2024-04-25T10:33:43.165 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T10:33:43.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.174+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb9480744b0 msgr2=0x7fb9480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.174+0000 7fb96bae0640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb9480744b0 0x7fb9480769c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb960000f80 tx=0x7fb960009040 comp rx=0 tx=0).stop 2024-04-25T10:33:43.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.174+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9641e33e0 msgr2=0x7fb96414ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.174+0000 7fb96bae0640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9641e33e0 0x7fb96414ca80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb95c02ad00 tx=0x7fb95c0019c0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.175+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 shutdown_connections 2024-04-25T10:33:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.175+0000 7fb96bae0640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb9480744b0 0x7fb9480769c0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb960000f80 tx=0x7fb960009040 comp rx=0 tx=0).stop 2024-04-25T10:33:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.175+0000 7fb96bae0640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9641e33e0 0x7fb96414ca80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.175+0000 7fb96bae0640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb96414bd90 0x7fb9640b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.175+0000 7fb96bae0640 1 --2- 172.21.15.103:0/1230549532 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb950005260 0x7fb9641df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.175+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 >> 172.21.15.103:0/1230549532 conn(0x7fb9640bb5e0 msgr2=0x7fb96406db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.177+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 shutdown_connections 2024-04-25T10:33:43.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.177+0000 7fb96bae0640 1 -- 172.21.15.103:0/1230549532 wait complete. 2024-04-25T10:33:43.198 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.304+0000 7f7a8cb34640 1 Processor -- start 2024-04-25T10:33:43.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.304+0000 7f7a8cb34640 1 -- start start 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8cb34640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7a8806c5c0 0x7f7a880b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8cb34640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8806cbe0 con 0x7f7a880b8a00 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8cb34640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8806cec0 con 0x7f7a8814cc60 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8cb34640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8806d1a0 con 0x7f7a8806c5c0 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7a8806c5c0 0x7f7a880b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a85d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7a880b8a00 0x7f7a88143490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51938/0 (socket says 172.21.15.103:51938) 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7a8806c5c0 0x7f7a880b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39070/0 (socket says 172.21.15.103:39070) 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a85d9b640 1 -- 172.21.15.103:0/1864691249 learned_addr learned my addr 172.21.15.103:0/1864691249 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8659c640 1 -- 172.21.15.103:0/1864691249 >> v1:172.21.15.132:6789/0 conn(0x7f7a8814cc60 legacy=0x7f7a8814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8659c640 1 -- 172.21.15.103:0/1864691249 >> v1:172.21.15.103:6789/0 conn(0x7f7a880b8a00 legacy=0x7f7a88143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8559a640 1 -- 172.21.15.103:0/1864691249 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145036348 0 0) 0x7f7a8806cbe0 con 0x7f7a880b8a00 2024-04-25T10:33:43.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.306+0000 7f7a8659c640 1 -- 172.21.15.103:0/1864691249 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a880b8e10 con 0x7f7a8806c5c0 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.307+0000 7f7a8659c640 1 --2- 172.21.15.103:0/1864691249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a880b6c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009d90 tx=0x7f7a7802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440b4dc0740f478a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.307+0000 7f7a8559a640 1 -- 172.21.15.103:0/1864691249 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78031600 con 0x7f7a8806c5c0 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.307+0000 7f7a8559a640 1 -- 172.21.15.103:0/1864691249 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a780317a0 con 0x7f7a8806c5c0 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.307+0000 7f7a8559a640 1 -- 172.21.15.103:0/1864691249 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78031b70 con 0x7f7a8806c5c0 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.307+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1864691249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 msgr2=0x7f7a880b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.307+0000 7f7a8cb34640 1 --2- 172.21.15.103:0/1864691249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a880b6c30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009d90 tx=0x7f7a7802a610 comp rx=0 tx=0).stop 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.308+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1864691249 shutdown_connections 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.308+0000 7f7a8cb34640 1 --2- 172.21.15.103:0/1864691249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a880b6c30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.308+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1864691249 >> 172.21.15.103:0/1864691249 conn(0x7f7a8806dd60 msgr2=0x7f7a880b8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.308+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1864691249 shutdown_connections 2024-04-25T10:33:43.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.308+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1864691249 wait complete. 2024-04-25T10:33:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.309+0000 7f7a8cb34640 1 Processor -- start 2024-04-25T10:33:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.309+0000 7f7a8cb34640 1 -- start start 2024-04-25T10:33:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8cb34640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a88148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8cb34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a880b8a00 0x7f7a880a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8cb34640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a8814cc60 0x7f7a881e2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8cb34640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7a88155080 con 0x7f7a8806c5c0 2024-04-25T10:33:43.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8cb34640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7a88154f00 con 0x7f7a880b8a00 2024-04-25T10:33:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8cb34640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f7a88155200 con 0x7f7a8814cc60 2024-04-25T10:33:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a88148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a88148be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39074/0 (socket says 172.21.15.103:39074) 2024-04-25T10:33:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8659c640 1 -- 172.21.15.103:0/1515407647 learned_addr learned my addr 172.21.15.103:0/1515407647 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8659c640 1 -- 172.21.15.103:0/1515407647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a8814cc60 msgr2=0x7f7a881e2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8659c640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a8814cc60 0x7f7a881e2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8659c640 1 -- 172.21.15.103:0/1515407647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a880b8a00 msgr2=0x7f7a880a10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.310+0000 7f7a8659c640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a880b8a00 0x7f7a880a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.311+0000 7f7a8659c640 1 -- 172.21.15.103:0/1515407647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a880a1620 con 0x7f7a8806c5c0 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.311+0000 7f7a8659c640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a88148be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009eb0 tx=0x7f7a78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.311+0000 7f7a76ffd640 1 -- 172.21.15.103:0/1515407647 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78040070 con 0x7f7a8806c5c0 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.311+0000 7f7a76ffd640 1 -- 172.21.15.103:0/1515407647 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78030be0 con 0x7f7a8806c5c0 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.311+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a880a0780 con 0x7f7a8806c5c0 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.311+0000 7f7a76ffd640 1 -- 172.21.15.103:0/1515407647 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7803c420 con 0x7f7a8806c5c0 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.311+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a880a0070 con 0x7f7a8806c5c0 2024-04-25T10:33:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.312+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8806a130 con 0x7f7a8806c5c0 2024-04-25T10:33:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.312+0000 7f7a76ffd640 1 -- 172.21.15.103:0/1515407647 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7a78039040 con 0x7f7a8806c5c0 2024-04-25T10:33:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.313+0000 7f7a76ffd640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7a680744e0 0x7f7a680769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.313+0000 7f7a85d9b640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7a680744e0 0x7f7a680769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.313+0000 7f7a76ffd640 1 -- 172.21.15.103:0/1515407647 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f7a780b66d0 con 0x7f7a8806c5c0 2024-04-25T10:33:43.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.313+0000 7f7a85d9b640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7a680744e0 0x7f7a680769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c007fd0 tx=0x7f7a7c007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.317+0000 7f7a76ffd640 1 -- 172.21.15.103:0/1515407647 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7a78080f20 con 0x7f7a8806c5c0 2024-04-25T10:33:43.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.493+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a88146f90 con 0x7f7a8806c5c0 2024-04-25T10:33:43.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.495+0000 7f7a76ffd640 1 -- 172.21.15.103:0/1515407647 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16678 (secure 0 0 0) 0x7f7a78080820 con 0x7f7a8806c5c0 2024-04-25T10:33:43.496 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:43.497 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":19,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:42.512779+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:43.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7a680744e0 msgr2=0x7f7a680769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7a680744e0 0x7f7a680769f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c007fd0 tx=0x7f7a7c007960 comp rx=0 tx=0).stop 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 msgr2=0x7f7a88148be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a88148be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009eb0 tx=0x7f7a78004a40 comp rx=0 tx=0).stop 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 shutdown_connections 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7a680744e0 0x7f7a680769f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7a8814cc60 0x7f7a881e2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a880b8a00 0x7f7a880a10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 --2- 172.21.15.103:0/1515407647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a8806c5c0 0x7f7a88148be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 >> 172.21.15.103:0/1515407647 conn(0x7f7a8806dd60 msgr2=0x7f7a880b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 shutdown_connections 2024-04-25T10:33:43.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.497+0000 7f7a8cb34640 1 -- 172.21.15.103:0/1515407647 wait complete. 2024-04-25T10:33:43.510 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:43.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.615+0000 7f0d88669640 1 Processor -- start 2024-04-25T10:33:43.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.615+0000 7f0d88669640 1 -- start start 2024-04-25T10:33:43.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.616+0000 7f0d88669640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b6a40 0x7f0d800b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.616+0000 7f0d88669640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d800735c0 con 0x7f0d801400b0 2024-04-25T10:33:43.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.616+0000 7f0d88669640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d80073860 con 0x7f0d800b64f0 2024-04-25T10:33:43.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.616+0000 7f0d88669640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f0d800b6e50 con 0x7f0d800b6a40 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.616+0000 7f0d86c06640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0d801400b0 0x7f0d801404c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51940/0 (socket says 172.21.15.103:51940) 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.616+0000 7f0d86c06640 1 -- 172.21.15.103:0/909583212 learned_addr learned my addr 172.21.15.103:0/909583212 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85c04640 1 --2- 172.21.15.103:0/909583212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b6a40 0x7f0d800b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85403640 1 -- 172.21.15.103:0/909583212 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032341533 0 0) 0x7f0d800735c0 con 0x7f0d801400b0 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85403640 1 -- 172.21.15.103:0/909583212 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d6c003520 con 0x7f0d801400b0 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85403640 1 -- 172.21.15.103:0/909583212 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392458006 0 0) 0x7f0d80073860 con 0x7f0d800b64f0 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85403640 1 -- 172.21.15.103:0/909583212 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d800735c0 con 0x7f0d800b64f0 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85c04640 1 -- 172.21.15.103:0/909583212 >> v1:172.21.15.132:6789/0 conn(0x7f0d800b64f0 legacy=0x7f0d800718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85c04640 1 -- 172.21.15.103:0/909583212 >> v1:172.21.15.103:6789/0 conn(0x7f0d801400b0 legacy=0x7f0d801404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85403640 1 -- 172.21.15.103:0/909583212 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3935505664 0 0) 0x7f0d6c003520 con 0x7f0d801400b0 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.617+0000 7f0d85c04640 1 -- 172.21.15.103:0/909583212 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d80073b40 con 0x7f0d800b6a40 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.618+0000 7f0d85c04640 1 --2- 172.21.15.103:0/909583212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b6a40 0x7f0d800b8520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009800 tx=0x7f0d7002a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bb444cfc154bf62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.618+0000 7f0d85403640 1 -- 172.21.15.103:0/909583212 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70037070 con 0x7f0d800b6a40 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.618+0000 7f0d85403640 1 -- 172.21.15.103:0/909583212 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7002abc0 con 0x7f0d800b6a40 2024-04-25T10:33:43.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.618+0000 7f0d85403640 1 -- 172.21.15.103:0/909583212 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d780019f0 con 0x7f0d800b6a40 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.619+0000 7f0d88669640 1 -- 172.21.15.103:0/909583212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b6a40 msgr2=0x7f0d800b8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.619+0000 7f0d88669640 1 --2- 172.21.15.103:0/909583212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b6a40 0x7f0d800b8520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009800 tx=0x7f0d7002a130 comp rx=0 tx=0).stop 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.619+0000 7f0d88669640 1 -- 172.21.15.103:0/909583212 shutdown_connections 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.619+0000 7f0d88669640 1 --2- 172.21.15.103:0/909583212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b6a40 0x7f0d800b8520 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.619+0000 7f0d88669640 1 -- 172.21.15.103:0/909583212 >> 172.21.15.103:0/909583212 conn(0x7f0d8006cfe0 msgr2=0x7f0d800b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.619+0000 7f0d88669640 1 -- 172.21.15.103:0/909583212 shutdown_connections 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.619+0000 7f0d88669640 1 -- 172.21.15.103:0/909583212 wait complete. 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.620+0000 7f0d88669640 1 Processor -- start 2024-04-25T10:33:43.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.620+0000 7f0d88669640 1 -- start start 2024-04-25T10:33:43.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d88669640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b64f0 0x7f0d80143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d88669640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d800b6a40 0x7f0d800b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d88669640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d801400b0 0x7f0d800b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d88669640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80072160 con 0x7f0d800b6a40 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d88669640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80071fe0 con 0x7f0d801400b0 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d88669640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f0d80151bc0 con 0x7f0d800b64f0 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d85c04640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d800b6a40 0x7f0d800b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d85c04640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d800b6a40 0x7f0d800b8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39078/0 (socket says 172.21.15.103:39078) 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d85c04640 1 -- 172.21.15.103:0/3076960278 learned_addr learned my addr 172.21.15.103:0/3076960278 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d86405640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b64f0 0x7f0d80143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.621+0000 7f0d86c06640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d801400b0 0x7f0d800b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d85c04640 1 -- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b64f0 msgr2=0x7f0d80143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d85c04640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b64f0 0x7f0d80143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d85c04640 1 -- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d801400b0 msgr2=0x7f0d800b9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d85c04640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d801400b0 0x7f0d800b9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d85c04640 1 -- 172.21.15.103:0/3076960278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d80137fa0 con 0x7f0d800b6a40 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d86c06640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d801400b0 0x7f0d800b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:43.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d85c04640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d800b6a40 0x7f0d800b8cd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d70000c00 tx=0x7f0d700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d76ffd640 1 -- 172.21.15.103:0/3076960278 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70037040 con 0x7f0d800b6a40 2024-04-25T10:33:43.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d76ffd640 1 -- 172.21.15.103:0/3076960278 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d70004230 con 0x7f0d800b6a40 2024-04-25T10:33:43.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d80138a40 con 0x7f0d800b6a40 2024-04-25T10:33:43.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d76ffd640 1 -- 172.21.15.103:0/3076960278 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70006e10 con 0x7f0d800b6a40 2024-04-25T10:33:43.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.622+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d800a07f0 con 0x7f0d800b6a40 2024-04-25T10:33:43.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.623+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8006a130 con 0x7f0d800b6a40 2024-04-25T10:33:43.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.623+0000 7f0d76ffd640 1 -- 172.21.15.103:0/3076960278 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0d70003610 con 0x7f0d800b6a40 2024-04-25T10:33:43.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.624+0000 7f0d76ffd640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f0d640744b0 0x7f0d640769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.624+0000 7f0d86405640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f0d640744b0 0x7f0d640769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.624+0000 7f0d76ffd640 1 -- 172.21.15.103:0/3076960278 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f0d700b5c40 con 0x7f0d800b6a40 2024-04-25T10:33:43.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.624+0000 7f0d86405640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f0d640744b0 0x7f0d640769c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0011e0 tx=0x7f0d7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.629+0000 7f0d76ffd640 1 -- 172.21.15.103:0/3076960278 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d70080460 con 0x7f0d800b6a40 2024-04-25T10:33:43.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.803+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d80143ee0 con 0x7f0d800b6a40 2024-04-25T10:33:43.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.804+0000 7f0d76ffd640 1 -- 172.21.15.103:0/3076960278 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16678 (secure 0 0 0) 0x7f0d7007fd60 con 0x7f0d800b6a40 2024-04-25T10:33:43.806 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:43.806 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":19,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:42.512779+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f0d640744b0 msgr2=0x7f0d640769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f0d640744b0 0x7f0d640769c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0011e0 tx=0x7f0d7c009040 comp rx=0 tx=0).stop 2024-04-25T10:33:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d800b6a40 msgr2=0x7f0d800b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d800b6a40 0x7f0d800b8cd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0d70000c00 tx=0x7f0d700046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 shutdown_connections 2024-04-25T10:33:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f0d640744b0 0x7f0d640769c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d801400b0 0x7f0d800b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d800b6a40 0x7f0d800b8cd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 --2- 172.21.15.103:0/3076960278 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0d800b64f0 0x7f0d80143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 >> 172.21.15.103:0/3076960278 conn(0x7f0d8006cfe0 msgr2=0x7f0d800ba070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:43.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 shutdown_connections 2024-04-25T10:33:43.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.806+0000 7f0d88669640 1 -- 172.21.15.103:0/3076960278 wait complete. 2024-04-25T10:33:43.819 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:33:43.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.927+0000 7fa8bbb35640 1 Processor -- start 2024-04-25T10:33:43.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.927+0000 7fa8bbb35640 1 -- start start 2024-04-25T10:33:43.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8bbb35640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8b409d820 0x7fa8b40bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8bbb35640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8b406d6d0 0x7fa8b4149640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8bbb35640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b406dae0 0x7fa8b414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8bbb35640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b40b9a30 con 0x7fa8b409d820 2024-04-25T10:33:43.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8bbb35640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b40b9d10 con 0x7fa8b406d6d0 2024-04-25T10:33:43.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8bbb35640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b40b9ff0 con 0x7fa8b406dae0 2024-04-25T10:33:43.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8b98d1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8b409d820 0x7fa8b40bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8b98d1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8b409d820 0x7fa8b40bdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48474/0 (socket says 172.21.15.103:48474) 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.928+0000 7fa8b98d1640 1 -- 172.21.15.103:0/3198350321 learned_addr learned my addr 172.21.15.103:0/3198350321 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8ba0d2640 1 --2- 172.21.15.103:0/3198350321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b406dae0 0x7fa8b414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8b90d0640 1 --2- 172.21.15.103:0/3198350321 >> v2:172.21.15.132:3300/0 conn(0x7fa8b406d6d0 0x7fa8b4149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8b98d1640 1 -- 172.21.15.103:0/3198350321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b406dae0 msgr2=0x7fa8b414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8b98d1640 1 --2- 172.21.15.103:0/3198350321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b406dae0 0x7fa8b414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8b98d1640 1 -- 172.21.15.103:0/3198350321 >> v2:172.21.15.132:3300/0 conn(0x7fa8b406d6d0 msgr2=0x7fa8b4149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8b98d1640 1 --2- 172.21.15.103:0/3198350321 >> v2:172.21.15.132:3300/0 conn(0x7fa8b406d6d0 0x7fa8b4149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8b98d1640 1 -- 172.21.15.103:0/3198350321 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b409dc30 con 0x7fa8b409d820 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8ba0d2640 1 --2- 172.21.15.103:0/3198350321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b406dae0 0x7fa8b414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.929+0000 7fa8b98d1640 1 --2- 172.21.15.103:0/3198350321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b409d820 0x7fa8b40bdf70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40a4b60 tx=0x7fa8b002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ab713c4a82c20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8b88cf640 1 -- 172.21.15.103:0/3198350321 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0037070 con 0x7fa8b409d820 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8b88cf640 1 -- 172.21.15.103:0/3198350321 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b0032440 con 0x7fa8b409d820 2024-04-25T10:33:43.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8b88cf640 1 -- 172.21.15.103:0/3198350321 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0032810 con 0x7fa8b409d820 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3198350321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b409d820 msgr2=0x7fa8b40bdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3198350321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b409d820 0x7fa8b40bdf70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40a4b60 tx=0x7fa8b002a140 comp rx=0 tx=0).stop 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3198350321 shutdown_connections 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3198350321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b406dae0 0x7fa8b414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3198350321 >> v2:172.21.15.132:3300/0 conn(0x7fa8b406d6d0 0x7fa8b4149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3198350321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b409d820 0x7fa8b40bdf70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3198350321 >> 172.21.15.103:0/3198350321 conn(0x7fa8b40bee10 msgr2=0x7fa8b40bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3198350321 shutdown_connections 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.930+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3198350321 wait complete. 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.932+0000 7fa8bbb35640 1 Processor -- start 2024-04-25T10:33:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.932+0000 7fa8bbb35640 1 -- start start 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8bbb35640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8b406d6d0 0x7fa8b40b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8bbb35640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b406dae0 0x7fa8b40b7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8bbb35640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b409d820 0x7fa8b41e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8bbb35640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40ba690 con 0x7fa8b406dae0 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8bbb35640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b40ba510 con 0x7fa8b406d6d0 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8bbb35640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b40b94c0 con 0x7fa8b409d820 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b406dae0 0x7fa8b40b7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b406dae0 0x7fa8b40b7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48482/0 (socket says 172.21.15.103:48482) 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 -- 172.21.15.103:0/3226713784 learned_addr learned my addr 172.21.15.103:0/3226713784 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8ba0d2640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b409d820 0x7fa8b41e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b98d1640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8b406d6d0 0x7fa8b40b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 -- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b409d820 msgr2=0x7fa8b41e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b409d820 0x7fa8b41e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 -- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8b406d6d0 msgr2=0x7fa8b40b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8b406d6d0 0x7fa8b40b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 -- 172.21.15.103:0/3226713784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b40b2090 con 0x7fa8b406dae0 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8ba0d2640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b409d820 0x7fa8b41e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b98d1640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8b406d6d0 0x7fa8b40b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8b90d0640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b406dae0 0x7fa8b40b7720 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400d800 tx=0x7fa8a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8aa7fc640 1 -- 172.21.15.103:0/3226713784 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4018030 con 0x7fa8b406dae0 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.933+0000 7fa8aa7fc640 1 -- 172.21.15.103:0/3226713784 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a4009640 con 0x7fa8b406dae0 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.934+0000 7fa8aa7fc640 1 -- 172.21.15.103:0/3226713784 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4009810 con 0x7fa8b406dae0 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.934+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b40b7c60 con 0x7fa8b406dae0 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.934+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b40b8980 con 0x7fa8b406dae0 2024-04-25T10:33:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.935+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b406a130 con 0x7fa8b406dae0 2024-04-25T10:33:43.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.935+0000 7fa8aa7fc640 1 -- 172.21.15.103:0/3226713784 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa8a401b070 con 0x7fa8b406dae0 2024-04-25T10:33:43.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.936+0000 7fa8aa7fc640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8980744e0 0x7fa8980769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:43.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.936+0000 7fa8b98d1640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8980744e0 0x7fa8980769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:43.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.936+0000 7fa8aa7fc640 1 -- 172.21.15.103:0/3226713784 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fa8a4095450 con 0x7fa8b406dae0 2024-04-25T10:33:43.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.936+0000 7fa8b98d1640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8980744e0 0x7fa8980769f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0034000 tx=0x7fa8b002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:43.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:43.941+0000 7fa8aa7fc640 1 -- 172.21.15.103:0/3226713784 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8b40b2090 con 0x7fa8b406dae0 2024-04-25T10:33:44.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.155+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa8b40b8b80 con 0x7fa8b406dae0 2024-04-25T10:33:44.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.169+0000 7fa8aa7fc640 1 -- 172.21.15.103:0/3226713784 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fa8a405fbe0 con 0x7fa8b406dae0 2024-04-25T10:33:44.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8980744e0 msgr2=0x7fa8980769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:44.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8980744e0 0x7fa8980769f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0034000 tx=0x7fa8b002e000 comp rx=0 tx=0).stop 2024-04-25T10:33:44.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b406dae0 msgr2=0x7fa8b40b7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:44.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b406dae0 0x7fa8b40b7720 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400d800 tx=0x7fa8a400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 shutdown_connections 2024-04-25T10:33:44.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8980744e0 0x7fa8980769f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8b409d820 0x7fa8b41e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8b406dae0 0x7fa8b40b7720 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 --2- 172.21.15.103:0/3226713784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8b406d6d0 0x7fa8b40b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.171+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 >> 172.21.15.103:0/3226713784 conn(0x7fa8b40bee10 msgr2=0x7fa8b40bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.172+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 shutdown_connections 2024-04-25T10:33:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.172+0000 7fa8bbb35640 1 -- 172.21.15.103:0/3226713784 wait complete. 2024-04-25T10:33:44.184 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:33:44.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:33:44.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.292+0000 7f4a9e6b6640 1 Processor -- start 2024-04-25T10:33:44.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.292+0000 7f4a9e6b6640 1 -- start start 2024-04-25T10:33:44.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9e6b6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a9809c340 0x7f4a980bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:44.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9e6b6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9814cd00 0x7f4a980a0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:44.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9e6b6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4a980a0a90 0x7f4a981499b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:44.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9e6b6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9814dab0 con 0x7f4a980a0a90 2024-04-25T10:33:44.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9e6b6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9814d460 con 0x7f4a9809c340 2024-04-25T10:33:44.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9e6b6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9814d740 con 0x7f4a9814cd00 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9cc53640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4a980a0a90 0x7f4a981499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9cc53640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4a980a0a90 0x7f4a981499b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48486/0 (socket says 172.21.15.103:48486) 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a9cc53640 1 -- 172.21.15.103:0/936407529 learned_addr learned my addr 172.21.15.103:0/936407529 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.293+0000 7f4a977fe640 1 --2- 172.21.15.103:0/936407529 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9814cd00 0x7f4a980a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a97fff640 1 --2- 172.21.15.103:0/936407529 >> v2:172.21.15.132:3300/0 conn(0x7f4a9809c340 0x7f4a980bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a9cc53640 1 -- 172.21.15.103:0/936407529 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9814cd00 msgr2=0x7f4a980a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a9cc53640 1 --2- 172.21.15.103:0/936407529 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9814cd00 0x7f4a980a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a9cc53640 1 -- 172.21.15.103:0/936407529 >> v2:172.21.15.132:3300/0 conn(0x7f4a9809c340 msgr2=0x7f4a980bbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a9cc53640 1 --2- 172.21.15.103:0/936407529 >> v2:172.21.15.132:3300/0 conn(0x7f4a9809c340 0x7f4a980bbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a9cc53640 1 -- 172.21.15.103:0/936407529 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9814d110 con 0x7f4a980a0a90 2024-04-25T10:33:44.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a9cc53640 1 --2- 172.21.15.103:0/936407529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981499b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a9806f520 tx=0x7f4a9002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540b07d37032da71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:44.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a96ffd640 1 -- 172.21.15.103:0/936407529 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90036070 con 0x7f4a980a0a90 2024-04-25T10:33:44.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a96ffd640 1 -- 172.21.15.103:0/936407529 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a90031600 con 0x7f4a980a0a90 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.294+0000 7f4a96ffd640 1 -- 172.21.15.103:0/936407529 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a900319d0 con 0x7f4a980a0a90 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/936407529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 msgr2=0x7f4a981499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/936407529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981499b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a9806f520 tx=0x7f4a9002a570 comp rx=0 tx=0).stop 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/936407529 shutdown_connections 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/936407529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981499b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/936407529 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9814cd00 0x7f4a980a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/936407529 >> v2:172.21.15.132:3300/0 conn(0x7f4a9809c340 0x7f4a980bbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/936407529 >> 172.21.15.103:0/936407529 conn(0x7f4a980bf350 msgr2=0x7f4a980bb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/936407529 shutdown_connections 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.295+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/936407529 wait complete. 2024-04-25T10:33:44.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.297+0000 7f4a9e6b6640 1 Processor -- start 2024-04-25T10:33:44.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.297+0000 7f4a9e6b6640 1 -- start start 2024-04-25T10:33:44.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a9e6b6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9809c340 0x7f4a980a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a9e6b6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a9e6b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a9814cd00 0x7f4a981e2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a9e6b6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9814a280 con 0x7f4a980a0a90 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a9e6b6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9814a100 con 0x7f4a9814cd00 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a9e6b6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f4a980b92e0 con 0x7f4a9809c340 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981df2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48490/0 (socket says 172.21.15.103:48490) 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 -- 172.21.15.103:0/214419154 learned_addr learned my addr 172.21.15.103:0/214419154 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a97fff640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9809c340 0x7f4a980a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a9cc53640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a9814cd00 0x7f4a981e2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 -- 172.21.15.103:0/214419154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9809c340 msgr2=0x7f4a980a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:44.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9809c340 0x7f4a980a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 -- 172.21.15.103:0/214419154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a9814cd00 msgr2=0x7f4a981e2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a9814cd00 0x7f4a981e2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 -- 172.21.15.103:0/214419154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a980a40b0 con 0x7f4a980a0a90 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.298+0000 7f4a977fe640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981df2a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00d5f0 tx=0x7f4a8c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.299+0000 7f4a94ff9640 1 -- 172.21.15.103:0/214419154 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0125f0 con 0x7f4a980a0a90 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.299+0000 7f4a94ff9640 1 -- 172.21.15.103:0/214419154 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8c019070 con 0x7f4a980a0a90 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.299+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a980a2eb0 con 0x7f4a980a0a90 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.299+0000 7f4a94ff9640 1 -- 172.21.15.103:0/214419154 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0129d0 con 0x7f4a980a0a90 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.299+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a980a3dd0 con 0x7f4a980a0a90 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.300+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a980a1ce0 con 0x7f4a980a0a90 2024-04-25T10:33:44.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.300+0000 7f4a94ff9640 1 -- 172.21.15.103:0/214419154 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4a8c012b70 con 0x7f4a980a0a90 2024-04-25T10:33:44.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.301+0000 7f4a94ff9640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4a840744b0 0x7f4a840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:44.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.301+0000 7f4a94ff9640 1 -- 172.21.15.103:0/214419154 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4a8c0954d0 con 0x7f4a980a0a90 2024-04-25T10:33:44.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.301+0000 7f4a97fff640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4a840744b0 0x7f4a840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:44.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.301+0000 7f4a97fff640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4a840744b0 0x7f4a840769c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a980ba720 tx=0x7f4a88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:44.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.305+0000 7f4a94ff9640 1 -- 172.21.15.103:0/214419154 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a8c05f610 con 0x7f4a980a0a90 2024-04-25T10:33:44.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:44.517+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4a9806a130 con 0x7f4a980a0a90 2024-04-25T10:33:45.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.174+0000 7f4a94ff9640 1 -- 172.21.15.103:0/214419154 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f4a8c093e20 con 0x7f4a980a0a90 2024-04-25T10:33:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.176+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4a840744b0 msgr2=0x7f4a840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.176+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4a840744b0 0x7f4a840769c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a980ba720 tx=0x7f4a88008040 comp rx=0 tx=0).stop 2024-04-25T10:33:45.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.176+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 msgr2=0x7f4a981df2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.176+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981df2a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00d5f0 tx=0x7f4a8c00dab0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.176+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 shutdown_connections 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.177+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4a840744b0 0x7f4a840769c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.177+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a9814cd00 0x7f4a981e2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.177+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4a980a0a90 0x7f4a981df2a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.177+0000 7f4a9e6b6640 1 --2- 172.21.15.103:0/214419154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a9809c340 0x7f4a980a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.177+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 >> 172.21.15.103:0/214419154 conn(0x7f4a980bf350 msgr2=0x7f4a9809f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.177+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 shutdown_connections 2024-04-25T10:33:45.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.177+0000 7f4a9e6b6640 1 -- 172.21.15.103:0/214419154 wait complete. 2024-04-25T10:33:45.190 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:33:45.190 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:33:45.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.296+0000 7fbe03157640 1 Processor -- start 2024-04-25T10:33:45.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.296+0000 7fbe03157640 1 -- start start 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.297+0000 7fbe03157640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc0720e0 0x7fbdfc0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.297+0000 7fbe03157640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0b84e0 0x7fbdfc0b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.297+0000 7fbe03157640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdfc0b27c0 con 0x7fbdfc0b23b0 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.297+0000 7fbe03157640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbdfc071970 con 0x7fbdfc0b84e0 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.297+0000 7fbe03157640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fbdfc0b2a80 con 0x7fbdfc0720e0 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfbfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbdfc0b23b0 0x7fbdfc1472a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:32992/0 (socket says 172.21.15.103:32992) 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfbfff640 1 -- 172.21.15.103:0/685659916 learned_addr learned my addr 172.21.15.103:0/685659916 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbe00ef3640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc0720e0 0x7fbdfc0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417614042 0 0) 0x7fbdfc0b27c0 con 0x7fbdfc0b23b0 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbe016f4640 1 --2- 172.21.15.103:0/685659916 >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0b84e0 0x7fbdfc0b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbde4003520 con 0x7fbdfc0b23b0 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2524151281 0 0) 0x7fbde4003520 con 0x7fbdfc0b23b0 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc0720e0 msgr2=0x7fbdfc0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc0720e0 0x7fbdfc0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0b84e0 msgr2=0x7fbdfc0b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 --2- 172.21.15.103:0/685659916 >> v2:172.21.15.132:3300/0 conn(0x7fbdfc0b84e0 0x7fbdfc0b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc071bc0 con 0x7fbdfc0b23b0 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fbdf0001670 con 0x7fbdfc0b23b0 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 >> v1:172.21.15.103:6789/0 conn(0x7fbdfc0b23b0 legacy=0x7fbdfc1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbde40039b0 0x7fbde4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbde4004800 0x7fbde4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde4005150 0x7fbde400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc071970 con 0x7fbde4005150 2024-04-25T10:33:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc0b2a80 con 0x7fbde4004800 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fbde400c030 con 0x7fbde40039b0 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbe00ef3640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc0720e0 0x7fbdfc0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbe016f4640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde4005150 0x7fbde400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.298+0000 7fbdfbfff640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbde4004800 0x7fbde4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbe00ef3640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbde40039b0 0x7fbde4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbe016f4640 1 -- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbde40039b0 msgr2=0x7fbde4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbe016f4640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbde40039b0 0x7fbde4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbe016f4640 1 -- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbde4004800 msgr2=0x7fbde4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbe016f4640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbde4004800 0x7fbde4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbe016f4640 1 -- 172.21.15.103:0/685659916 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde4003520 con 0x7fbde4005150 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbe00ef3640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbde40039b0 0x7fbde4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbe016f4640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde4005150 0x7fbde400b9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009fc0 tx=0x7fbde4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbf368b72329ac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4009c10 con 0x7fbde4005150 2024-04-25T10:33:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.299+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf4036070 con 0x7fbde4005150 2024-04-25T10:33:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.300+0000 7fbdfb7fe640 1 -- 172.21.15.103:0/685659916 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf402d070 con 0x7fbde4005150 2024-04-25T10:33:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.300+0000 7fbe03157640 1 -- 172.21.15.103:0/685659916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde4005150 msgr2=0x7fbde400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.300+0000 7fbe03157640 1 --2- 172.21.15.103:0/685659916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbde4005150 0x7fbde400b9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009fc0 tx=0x7fbde4005830 comp rx=0 tx=0).stop 2024-04-25T10:33:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.300+0000 7fbe016f4640 1 -- 172.21.15.103:0/685659916 reap_dead start 2024-04-25T10:33:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.300+0000 7fbe03157640 1 -- 172.21.15.103:0/685659916 shutdown_connections 2024-04-25T10:33:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.300+0000 7fbe03157640 1 -- 172.21.15.103:0/685659916 >> 172.21.15.103:0/685659916 conn(0x7fbdfc0b93f0 msgr2=0x7fbdfc0b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.300+0000 7fbe03157640 1 -- 172.21.15.103:0/685659916 shutdown_connections 2024-04-25T10:33:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.300+0000 7fbe03157640 1 -- 172.21.15.103:0/685659916 wait complete. 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.302+0000 7fbe03157640 1 Processor -- start 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.302+0000 7fbe03157640 1 -- start start 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe03157640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdfc0a27c0 0x7fbdfc1d2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe03157640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc143ef0 0x7fbdfc144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe03157640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc13eac0 0x7fbdfc13eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe03157640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc0b6660 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe03157640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc0b64e0 con 0x7fbdfc13eac0 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe03157640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fbdfc0b1df0 con 0x7fbdfc143ef0 2024-04-25T10:33:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdfc0a27c0 0x7fbdfc1d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdfc0a27c0 0x7fbdfc1d2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48506/0 (socket says 172.21.15.103:48506) 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 -- 172.21.15.103:0/3128185473 learned_addr learned my addr 172.21.15.103:0/3128185473 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbdfbfff640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc143ef0 0x7fbdfc144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe016f4640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc13eac0 0x7fbdfc13eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 -- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc143ef0 msgr2=0x7fbdfc144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc143ef0 0x7fbdfc144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 -- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc13eac0 msgr2=0x7fbdfc13eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc13eac0 0x7fbdfc13eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 -- 172.21.15.103:0/3128185473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc14b570 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe016f4640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc13eac0 0x7fbdfc13eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.303+0000 7fbe00ef3640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdfc0a27c0 0x7fbdfc1d2430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0116d0 tx=0x7fbdec011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.304+0000 7fbdf97fa640 1 -- 172.21.15.103:0/3128185473 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec00f9c0 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.304+0000 7fbdf97fa640 1 -- 172.21.15.103:0/3128185473 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdec00fb60 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.304+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdfc142ea0 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.304+0000 7fbdf97fa640 1 -- 172.21.15.103:0/3128185473 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec015460 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.304+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdfc13f410 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.305+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdfc14b360 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.305+0000 7fbdf97fa640 1 -- 172.21.15.103:0/3128185473 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbdec015600 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.306+0000 7fbdf97fa640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbde80744e0 0x7fbde80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.306+0000 7fbdfbfff640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbde80744e0 0x7fbde80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.306+0000 7fbdf97fa640 1 -- 172.21.15.103:0/3128185473 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbdec095b80 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.306+0000 7fbdfbfff640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbde80744e0 0x7fbde80769f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc071340 tx=0x7fbdf00078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.310+0000 7fbdf97fa640 1 -- 172.21.15.103:0/3128185473 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbdec019030 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.525+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdfc06a130 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.525+0000 7fbdf97fa640 1 -- 172.21.15.103:0/3128185473 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3530 (secure 0 0 0) 0x7fbdec060430 con 0x7fbdfc0a27c0 2024-04-25T10:33:45.527 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:45.527 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/617098639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":617098639},{"type":"v1","addr":"172.21.15.132:6833","nonce":617098639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:33:42.512740+0000","modified":"2024-04-25T10:33:44.518295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/2389441335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2389441335},{"type":"v1","addr":"172.21.15.103:6835","nonce":2389441335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-25T10:33:45.527 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-04-25T10:33:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbde80744e0 msgr2=0x7fbde80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbde80744e0 0x7fbde80769f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc071340 tx=0x7fbdf00078f0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdfc0a27c0 msgr2=0x7fbdfc1d2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdfc0a27c0 0x7fbdfc1d2430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0116d0 tx=0x7fbdec011b90 comp rx=0 tx=0).stop 2024-04-25T10:33:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 shutdown_connections 2024-04-25T10:33:45.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbde80744e0 0x7fbde80769f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbdfc13eac0 0x7fbdfc13eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbdfc143ef0 0x7fbdfc144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 --2- 172.21.15.103:0/3128185473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbdfc0a27c0 0x7fbdfc1d2430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 >> 172.21.15.103:0/3128185473 conn(0x7fbdfc0b93f0 msgr2=0x7fbdfc070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 shutdown_connections 2024-04-25T10:33:45.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.527+0000 7fbe03157640 1 -- 172.21.15.103:0/3128185473 wait complete. 2024-04-25T10:33:45.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:45.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.646+0000 7fdacc172640 1 Processor -- start 2024-04-25T10:33:45.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.646+0000 7fdacc172640 1 -- start start 2024-04-25T10:33:45.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdacc172640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4071e50 0x7fdac414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdacc172640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdac414d050 0x7fdac4153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdacc172640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac406e960 con 0x7fdac40b2fe0 2024-04-25T10:33:45.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdacc172640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fdac406de80 con 0x7fdac414d050 2024-04-25T10:33:45.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdacc172640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fdac406e160 con 0x7fdac4071e50 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac9f0e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdac40b2fe0 0x7fdac40b8300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:32998/0 (socket says 172.21.15.103:32998) 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac9f0e640 1 -- 172.21.15.103:0/4213048324 learned_addr learned my addr 172.21.15.103:0/4213048324 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3600922705 0 0) 0x7fdac406e960 con 0x7fdac40b2fe0 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac970d640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4071e50 0x7fdac414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdab0003520 con 0x7fdac40b2fe0 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdaca70f640 1 --2- 172.21.15.103:0/4213048324 >> v2:172.21.15.132:3300/0 conn(0x7fdac414d050 0x7fdac4153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3649304689 0 0) 0x7fdab0003520 con 0x7fdac40b2fe0 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4071e50 msgr2=0x7fdac414cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac8f0c640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4071e50 0x7fdac414cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 >> v2:172.21.15.132:3300/0 conn(0x7fdac414d050 msgr2=0x7fdac4153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.647+0000 7fdac8f0c640 1 --2- 172.21.15.103:0/4213048324 >> v2:172.21.15.132:3300/0 conn(0x7fdac414d050 0x7fdac4153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac406e440 con 0x7fdac40b2fe0 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fdac0001670 con 0x7fdac40b2fe0 2024-04-25T10:33:45.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 >> v1:172.21.15.103:6789/0 conn(0x7fdac40b2fe0 legacy=0x7fdac40b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdab00039b0 0x7fdab0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdab0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4071e50 0x7fdab0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdac406de80 con 0x7fdab0004800 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdac406e160 con 0x7fdab00039b0 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fdab000ba40 con 0x7fdac4071e50 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac970d640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdab0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac9f0e640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdab00039b0 0x7fdab0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdaca70f640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4071e50 0x7fdab0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac970d640 1 -- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4071e50 msgr2=0x7fdab0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac970d640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4071e50 0x7fdab0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac970d640 1 -- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdab00039b0 msgr2=0x7fdab0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac970d640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdab00039b0 0x7fdab0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.648+0000 7fdac970d640 1 -- 172.21.15.103:0/4213048324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab0003520 con 0x7fdab0004800 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.649+0000 7fdac970d640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdab0004c10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009a90 tx=0x7fdab0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3d754a1acc09b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.649+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4036070 con 0x7fdab0004800 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.649+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab4031400 con 0x7fdab0004800 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.649+0000 7fdac8f0c640 1 -- 172.21.15.103:0/4213048324 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4009690 con 0x7fdab0004800 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.649+0000 7fdacc172640 1 -- 172.21.15.103:0/4213048324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 msgr2=0x7fdab0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.649+0000 7fdacc172640 1 --2- 172.21.15.103:0/4213048324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdab0004c10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009a90 tx=0x7fdab0005830 comp rx=0 tx=0).stop 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.649+0000 7fdaca70f640 1 -- 172.21.15.103:0/4213048324 reap_dead start 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.650+0000 7fdacc172640 1 -- 172.21.15.103:0/4213048324 shutdown_connections 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.650+0000 7fdacc172640 1 -- 172.21.15.103:0/4213048324 >> 172.21.15.103:0/4213048324 conn(0x7fdac40b93f0 msgr2=0x7fdac40b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.650+0000 7fdacc172640 1 -- 172.21.15.103:0/4213048324 shutdown_connections 2024-04-25T10:33:45.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.650+0000 7fdacc172640 1 -- 172.21.15.103:0/4213048324 wait complete. 2024-04-25T10:33:45.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.651+0000 7fdacc172640 1 Processor -- start 2024-04-25T10:33:45.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.651+0000 7fdacc172640 1 -- start start 2024-04-25T10:33:45.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdacc172640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdac41d5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdacc172640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4147070 0x7fdac40b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdacc172640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdac41e2650 0x7fdac4142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdacc172640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40b3570 con 0x7fdab0004800 2024-04-25T10:33:45.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdacc172640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdac40b33f0 con 0x7fdac41e2650 2024-04-25T10:33:45.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdacc172640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fdac4072260 con 0x7fdac4147070 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac9f0e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdac41d5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac9f0e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdac41d5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48520/0 (socket says 172.21.15.103:48520) 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac9f0e640 1 -- 172.21.15.103:0/26733537 learned_addr learned my addr 172.21.15.103:0/26733537 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac970d640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4147070 0x7fdac40b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdaca70f640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdac41e2650 0x7fdac4142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac9f0e640 1 -- 172.21.15.103:0/26733537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4147070 msgr2=0x7fdac40b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac9f0e640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4147070 0x7fdac40b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac9f0e640 1 -- 172.21.15.103:0/26733537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdac41e2650 msgr2=0x7fdac4142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac9f0e640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdac41e2650 0x7fdac4142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.652+0000 7fdac9f0e640 1 -- 172.21.15.103:0/26733537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac41e2bc0 con 0x7fdab0004800 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.653+0000 7fdac9f0e640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdac41d5ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdac0007370 tx=0x7fdac0007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.653+0000 7fdaba7fc640 1 -- 172.21.15.103:0/26733537 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac000f9c0 con 0x7fdab0004800 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.653+0000 7fdaba7fc640 1 -- 172.21.15.103:0/26733537 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac0018070 con 0x7fdab0004800 2024-04-25T10:33:45.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.653+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac41e2ea0 con 0x7fdab0004800 2024-04-25T10:33:45.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.653+0000 7fdaba7fc640 1 -- 172.21.15.103:0/26733537 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac000fdc0 con 0x7fdab0004800 2024-04-25T10:33:45.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.653+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac40b5290 con 0x7fdab0004800 2024-04-25T10:33:45.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.654+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac406a130 con 0x7fdab0004800 2024-04-25T10:33:45.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.654+0000 7fdaba7fc640 1 -- 172.21.15.103:0/26733537 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdac001d460 con 0x7fdab0004800 2024-04-25T10:33:45.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.655+0000 7fdaba7fc640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdaa80744b0 0x7fdaa80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.655+0000 7fdac970d640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdaa80744b0 0x7fdaa80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.655+0000 7fdaba7fc640 1 -- 172.21.15.103:0/26733537 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdac0095250 con 0x7fdab0004800 2024-04-25T10:33:45.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.655+0000 7fdac970d640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdaa80744b0 0x7fdaa80769c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009a90 tx=0x7fdab4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.659+0000 7fdaba7fc640 1 -- 172.21.15.103:0/26733537 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdac005fb00 con 0x7fdab0004800 2024-04-25T10:33:45.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.836+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdac40b88d0 con 0x7fdab0004800 2024-04-25T10:33:45.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.837+0000 7fdaba7fc640 1 -- 172.21.15.103:0/26733537 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16665 (secure 0 0 0) 0x7fdac005f400 con 0x7fdab0004800 2024-04-25T10:33:45.839 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:45.839 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:44.163567+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:45.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdaa80744b0 msgr2=0x7fdaa80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdaa80744b0 0x7fdaa80769c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009a90 tx=0x7fdab4008030 comp rx=0 tx=0).stop 2024-04-25T10:33:45.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 msgr2=0x7fdac41d5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdac41d5ff0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdac0007370 tx=0x7fdac0007830 comp rx=0 tx=0).stop 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 shutdown_connections 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdaa80744b0 0x7fdaa80769c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdac41e2650 0x7fdac4142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdac4147070 0x7fdac40b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 --2- 172.21.15.103:0/26733537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab0004800 0x7fdac41d5ff0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 >> 172.21.15.103:0/26733537 conn(0x7fdac40b93f0 msgr2=0x7fdac4070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 shutdown_connections 2024-04-25T10:33:45.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.839+0000 7fdacc172640 1 -- 172.21.15.103:0/26733537 wait complete. 2024-04-25T10:33:45.853 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:33:45.853 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:33:45.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.963+0000 7f43593ce640 1 Processor -- start 2024-04-25T10:33:45.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.963+0000 7f43593ce640 1 -- start start 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.964+0000 7f43593ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4354143960 0x7f4354149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.964+0000 7f43593ce640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43540be4c0 0x7f43540bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.964+0000 7f43593ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43540bda00 con 0x7f435406d2d0 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.964+0000 7f43593ce640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f43540be030 con 0x7f43540be4c0 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.964+0000 7f43593ce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f43541499c0 con 0x7f4354143960 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.964+0000 7f434a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43540be4c0 0x7f43540bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.964+0000 7f434a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43540be4c0 0x7f43540bbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48534/0 (socket says 172.21.15.103:48534) 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.964+0000 7f434a7fc640 1 -- 172.21.15.103:0/3793126852 learned_addr learned my addr 172.21.15.103:0/3793126852 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.965+0000 7f4352ffd640 1 --2- 172.21.15.103:0/3793126852 >> v2:172.21.15.132:3300/0 conn(0x7f4354143960 0x7f4354149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.965+0000 7f434a7fc640 1 -- 172.21.15.103:0/3793126852 >> v2:172.21.15.132:3300/0 conn(0x7f4354143960 msgr2=0x7f4354149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:45.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.965+0000 7f434a7fc640 1 --2- 172.21.15.103:0/3793126852 >> v2:172.21.15.132:3300/0 conn(0x7f4354143960 0x7f4354149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.965+0000 7f434a7fc640 1 -- 172.21.15.103:0/3793126852 >> v1:172.21.15.132:6789/0 conn(0x7f435406d2d0 legacy=0x7f435406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.965+0000 7f434a7fc640 1 -- 172.21.15.103:0/3793126852 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43540bdcc0 con 0x7f43540be4c0 2024-04-25T10:33:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.965+0000 7f434a7fc640 1 --2- 172.21.15.103:0/3793126852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43540bbb00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f43540be1b0 tx=0x7f433c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5805c328661848 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43527fc640 1 -- 172.21.15.103:0/3793126852 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c037070 con 0x7f43540be4c0 2024-04-25T10:33:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43527fc640 1 -- 172.21.15.103:0/3793126852 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c032440 con 0x7f43540be4c0 2024-04-25T10:33:45.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43527fc640 1 -- 172.21.15.103:0/3793126852 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c032810 con 0x7f43540be4c0 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43593ce640 1 -- 172.21.15.103:0/3793126852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 msgr2=0x7f43540bbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43593ce640 1 --2- 172.21.15.103:0/3793126852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43540bbb00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f43540be1b0 tx=0x7f433c02a1e0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43593ce640 1 -- 172.21.15.103:0/3793126852 shutdown_connections 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43593ce640 1 --2- 172.21.15.103:0/3793126852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43540bbb00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43593ce640 1 --2- 172.21.15.103:0/3793126852 >> v2:172.21.15.132:3300/0 conn(0x7f4354143960 0x7f4354149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43593ce640 1 -- 172.21.15.103:0/3793126852 >> 172.21.15.103:0/3793126852 conn(0x7f43540befa0 msgr2=0x7f43540bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43593ce640 1 -- 172.21.15.103:0/3793126852 shutdown_connections 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.966+0000 7f43593ce640 1 -- 172.21.15.103:0/3793126852 wait complete. 2024-04-25T10:33:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.968+0000 7f43593ce640 1 Processor -- start 2024-04-25T10:33:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.968+0000 7f43593ce640 1 -- start start 2024-04-25T10:33:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f43593ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435406d2d0 0x7f4354142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f43593ce640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43541e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f43593ce640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4354143960 0x7f43541d8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f43593ce640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4354153f20 con 0x7f43540be4c0 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f43593ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4354153da0 con 0x7f435406d2d0 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f43593ce640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f43541540a0 con 0x7f4354143960 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43541e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43541e2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48544/0 (socket says 172.21.15.103:48544) 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 -- 172.21.15.103:0/235516316 learned_addr learned my addr 172.21.15.103:0/235516316 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f4352ffd640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435406d2d0 0x7f4354142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f43537fe640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4354143960 0x7f43541d8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 -- 172.21.15.103:0/235516316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4354143960 msgr2=0x7f43541d8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4354143960 0x7f43541d8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 -- 172.21.15.103:0/235516316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435406d2d0 msgr2=0x7f4354142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435406d2d0 0x7f4354142330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 -- 172.21.15.103:0/235516316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43541e3110 con 0x7f43540be4c0 2024-04-25T10:33:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.969+0000 7f434a7fc640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43541e2bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f433c02a220 tx=0x7f433c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.970+0000 7f434bfff640 1 -- 172.21.15.103:0/235516316 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c041020 con 0x7f43540be4c0 2024-04-25T10:33:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.970+0000 7f434bfff640 1 -- 172.21.15.103:0/235516316 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f433c0306c0 con 0x7f43540be4c0 2024-04-25T10:33:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.970+0000 7f434bfff640 1 -- 172.21.15.103:0/235516316 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c037040 con 0x7f43540be4c0 2024-04-25T10:33:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.970+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435414cb80 con 0x7f43540be4c0 2024-04-25T10:33:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.970+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435414ce20 con 0x7f43540be4c0 2024-04-25T10:33:45.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.971+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435406a130 con 0x7f43540be4c0 2024-04-25T10:33:45.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.971+0000 7f434bfff640 1 -- 172.21.15.103:0/235516316 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f433c044020 con 0x7f43540be4c0 2024-04-25T10:33:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.972+0000 7f434bfff640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f43340744e0 0x7f43340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.972+0000 7f4352ffd640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f43340744e0 0x7f43340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.972+0000 7f434bfff640 1 -- 172.21.15.103:0/235516316 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f433c0b5800 con 0x7f43540be4c0 2024-04-25T10:33:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.972+0000 7f4352ffd640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f43340744e0 0x7f43340769f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43540b93e0 tx=0x7f4344008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:45.976+0000 7f434bfff640 1 -- 172.21.15.103:0/235516316 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f433c04b030 con 0x7f43540be4c0 2024-04-25T10:33:46.133 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-04-25T10:33:46.132+0000 7f8389a05640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:33:46.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.146+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4354148fc0 con 0x7f43340744e0 2024-04-25T10:33:46.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.152+0000 7f434bfff640 1 -- 172.21.15.103:0/235516316 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237114 (secure 0 0 0) 0x7f4354148fc0 con 0x7f43340744e0 2024-04-25T10:33:46.158 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:46.160 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:33:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f43340744e0 msgr2=0x7f43340769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f43340744e0 0x7f43340769f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f43540b93e0 tx=0x7f4344008040 comp rx=0 tx=0).stop 2024-04-25T10:33:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 msgr2=0x7f43541e2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43541e2bd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f433c02a220 tx=0x7f433c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 shutdown_connections 2024-04-25T10:33:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f43340744e0 0x7f43340769f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4354143960 0x7f43541d8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43540be4c0 0x7f43541e2bd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 --2- 172.21.15.103:0/235516316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435406d2d0 0x7f4354142330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 >> 172.21.15.103:0/235516316 conn(0x7f43540befa0 msgr2=0x7f43540bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 shutdown_connections 2024-04-25T10:33:46.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.155+0000 7f43593ce640 1 -- 172.21.15.103:0/235516316 wait complete. 2024-04-25T10:33:46.168 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-25T10:33:44.491438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218548,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756172,"statfs":{"total":773094113280,"available":772870320128,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000633"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":102,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-25T10:33:35.809223+0000","last_change":"2024-04-25T10:33:31.708843+0000","last_active":"2024-04-25T10:33:35.809223+0000","last_peered":"2024-04-25T10:33:35.809223+0000","last_clean":"2024-04-25T10:33:35.809223+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:33:35.809223+0000","last_undegraded":"2024-04-25T10:33:35.809223+0000","last_fullsized":"2024-04-25T10:33:35.809223+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_clean_scrub_stamp":"2024-04-25T10:33:30.626866+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:10.475782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:42.141119+0000","last_change":"2024-04-25T10:33:42.141119+0000","last_active":"2024-04-25T10:33:42.141119+0000","last_peered":"2024-04-25T10:33:42.141119+0000","last_clean":"2024-04-25T10:33:42.141119+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:42.141119+0000","last_undegraded":"2024-04-25T10:33:42.141119+0000","last_fullsized":"2024-04-25T10:33:42.141119+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:33:41.136244+0000","last_change":"2024-04-25T10:33:41.136244+0000","last_active":"2024-04-25T10:33:41.136244+0000","last_peered":"2024-04-25T10:33:41.136244+0000","last_clean":"2024-04-25T10:33:41.136244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:33:41.136244+0000","last_undegraded":"2024-04-25T10:33:41.136244+0000","last_fullsized":"2024-04-25T10:33:41.136244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:33:46.174 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:33:46.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.315+0000 7f982110d640 1 Processor -- start 2024-04-25T10:33:46.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.315+0000 7f982110d640 1 -- start start 2024-04-25T10:33:46.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.316+0000 7f982110d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0720e0 0x7f981c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.316+0000 7f982110d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c0b27c0 con 0x7f981c0b23b0 2024-04-25T10:33:46.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.316+0000 7f982110d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c0b2a80 con 0x7f981c0b84e0 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.316+0000 7f982110d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f981c071970 con 0x7f981c0720e0 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.316+0000 7f981a59c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f981c0b23b0 0x7f981c1472a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33012/0 (socket says 172.21.15.103:33012) 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.316+0000 7f981a59c640 1 -- 172.21.15.103:0/4059936503 learned_addr learned my addr 172.21.15.103:0/4059936503 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.316+0000 7f981ad9d640 1 --2- 172.21.15.103:0/4059936503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0720e0 0x7f981c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.317+0000 7f9819d9b640 1 -- 172.21.15.103:0/4059936503 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094126565 0 0) 0x7f981c0b27c0 con 0x7f981c0b23b0 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.317+0000 7f9819d9b640 1 -- 172.21.15.103:0/4059936503 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9804003520 con 0x7f981c0b23b0 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.317+0000 7f981ad9d640 1 -- 172.21.15.103:0/4059936503 >> v1:172.21.15.132:6789/0 conn(0x7f981c0b84e0 legacy=0x7f981c0b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.317+0000 7f9819d9b640 1 -- 172.21.15.103:0/4059936503 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596801890 0 0) 0x7f981c0b2a80 con 0x7f981c0b84e0 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.317+0000 7f981ad9d640 1 -- 172.21.15.103:0/4059936503 >> v1:172.21.15.103:6789/0 conn(0x7f981c0b23b0 legacy=0x7f981c1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.317+0000 7f981ad9d640 1 -- 172.21.15.103:0/4059936503 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c071bc0 con 0x7f981c0720e0 2024-04-25T10:33:46.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f981ad9d640 1 --2- 172.21.15.103:0/4059936503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0720e0 0x7f981c0b1df0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f980c0097d0 tx=0x7f980c02a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76a977ee055d36c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:46.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f9819d9b640 1 -- 172.21.15.103:0/4059936503 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c037070 con 0x7f981c0720e0 2024-04-25T10:33:46.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f9819d9b640 1 -- 172.21.15.103:0/4059936503 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c02ab70 con 0x7f981c0720e0 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f9819d9b640 1 -- 172.21.15.103:0/4059936503 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810001670 con 0x7f981c0720e0 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f982110d640 1 -- 172.21.15.103:0/4059936503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0720e0 msgr2=0x7f981c0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f982110d640 1 --2- 172.21.15.103:0/4059936503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0720e0 0x7f981c0b1df0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f980c0097d0 tx=0x7f980c02a0e0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f982110d640 1 -- 172.21.15.103:0/4059936503 shutdown_connections 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f982110d640 1 --2- 172.21.15.103:0/4059936503 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0720e0 0x7f981c0b1df0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f982110d640 1 -- 172.21.15.103:0/4059936503 >> 172.21.15.103:0/4059936503 conn(0x7f981c0b93f0 msgr2=0x7f981c0b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f982110d640 1 -- 172.21.15.103:0/4059936503 shutdown_connections 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.318+0000 7f982110d640 1 -- 172.21.15.103:0/4059936503 wait complete. 2024-04-25T10:33:46.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.320+0000 7f982110d640 1 Processor -- start 2024-04-25T10:33:46.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.320+0000 7f982110d640 1 -- start start 2024-04-25T10:33:46.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f982110d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f981c0720e0 0x7f981c144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f982110d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0b23b0 0x7f981c13a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f982110d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981c0b84e0 0x7f981c13aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f982110d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f981c152bd0 con 0x7f981c0b84e0 2024-04-25T10:33:46.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f982110d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f981c0b88f0 con 0x7f981c0720e0 2024-04-25T10:33:46.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f982110d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f981c152d50 con 0x7f981c0b23b0 2024-04-25T10:33:46.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f981b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981c0b84e0 0x7f981c13aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f981b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981c0b84e0 0x7f981c13aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48558/0 (socket says 172.21.15.103:48558) 2024-04-25T10:33:46.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f981b59e640 1 -- 172.21.15.103:0/277096135 learned_addr learned my addr 172.21.15.103:0/277096135 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:46.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f981a59c640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0b23b0 0x7f981c13a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.321+0000 7f981ad9d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f981c0720e0 0x7f981c144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f981b59e640 1 -- 172.21.15.103:0/277096135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0b23b0 msgr2=0x7f981c13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f981b59e640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0b23b0 0x7f981c13a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f981b59e640 1 -- 172.21.15.103:0/277096135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f981c0720e0 msgr2=0x7f981c144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f981b59e640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f981c0720e0 0x7f981c144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f981b59e640 1 -- 172.21.15.103:0/277096135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c13f7c0 con 0x7f981c0b84e0 2024-04-25T10:33:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f981b59e640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981c0b84e0 0x7f981c13aec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f981400c780 tx=0x7f981400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f98037fe640 1 -- 172.21.15.103:0/277096135 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814003b70 con 0x7f981c0b84e0 2024-04-25T10:33:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f98037fe640 1 -- 172.21.15.103:0/277096135 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9814003d10 con 0x7f981c0b84e0 2024-04-25T10:33:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c13ee20 con 0x7f981c0b84e0 2024-04-25T10:33:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f98037fe640 1 -- 172.21.15.103:0/277096135 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814005270 con 0x7f981c0b84e0 2024-04-25T10:33:46.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.322+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c1e0be0 con 0x7f981c0b84e0 2024-04-25T10:33:46.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.323+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c1e0e40 con 0x7f981c0b84e0 2024-04-25T10:33:46.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.324+0000 7f98037fe640 1 -- 172.21.15.103:0/277096135 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9814005410 con 0x7f981c0b84e0 2024-04-25T10:33:46.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.324+0000 7f98037fe640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98080744b0 0x7f98080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.324+0000 7f98037fe640 1 -- 172.21.15.103:0/277096135 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f98140950c0 con 0x7f981c0b84e0 2024-04-25T10:33:46.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.324+0000 7f981ad9d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98080744b0 0x7f98080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.324+0000 7f981ad9d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98080744b0 0x7f98080769c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f980c034000 tx=0x7f980c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:46.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.329+0000 7f98037fe640 1 -- 172.21.15.103:0/277096135 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f981405f8e0 con 0x7f981c0b84e0 2024-04-25T10:33:46.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.503+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f981c13f9e0 con 0x7f98080744b0 2024-04-25T10:33:46.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.509+0000 7f98037fe640 1 -- 172.21.15.103:0/277096135 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251906 (secure 0 0 0) 0x7f981c13f9e0 con 0x7f98080744b0 2024-04-25T10:33:46.513 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:46.514 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:33:46.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98080744b0 msgr2=0x7f98080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98080744b0 0x7f98080769c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f980c034000 tx=0x7f980c02e000 comp rx=0 tx=0).stop 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981c0b84e0 msgr2=0x7f981c13aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981c0b84e0 0x7f981c13aec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f981400c780 tx=0x7f981400cb80 comp rx=0 tx=0).stop 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 shutdown_connections 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98080744b0 0x7f98080769c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f981c0b84e0 0x7f981c13aec0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f981c0b23b0 0x7f981c13a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 --2- 172.21.15.103:0/277096135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f981c0720e0 0x7f981c144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 >> 172.21.15.103:0/277096135 conn(0x7f981c0b93f0 msgr2=0x7f981c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 shutdown_connections 2024-04-25T10:33:46.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.512+0000 7f982110d640 1 -- 172.21.15.103:0/277096135 wait complete. 2024-04-25T10:33:46.524 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T10:33:46.491737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218960,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.349686"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.187422+0000","last_change":"2024-04-25T10:33:43.181183+0000","last_active":"2024-04-25T10:33:43.187422+0000","last_peered":"2024-04-25T10:33:43.187422+0000","last_clean":"2024-04-25T10:33:43.187422+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:33:43.187422+0000","last_undegraded":"2024-04-25T10:33:43.187422+0000","last_fullsized":"2024-04-25T10:33:43.187422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065236+0000","last_change":"2024-04-25T10:33:43.170436+0000","last_active":"2024-04-25T10:33:45.065236+0000","last_peered":"2024-04-25T10:33:45.065236+0000","last_clean":"2024-04-25T10:33:45.065236+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:33:45.065236+0000","last_undegraded":"2024-04-25T10:33:45.065236+0000","last_fullsized":"2024-04-25T10:33:45.065236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167080+0000","last_change":"2024-04-25T10:33:43.181271+0000","last_active":"2024-04-25T10:33:44.167080+0000","last_peered":"2024-04-25T10:33:44.167080+0000","last_clean":"2024-04-25T10:33:44.167080+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:33:44.167080+0000","last_undegraded":"2024-04-25T10:33:44.167080+0000","last_fullsized":"2024-04-25T10:33:44.167080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.179104+0000","last_change":"2024-04-25T10:33:43.176831+0000","last_active":"2024-04-25T10:33:43.179104+0000","last_peered":"2024-04-25T10:33:43.179104+0000","last_clean":"2024-04-25T10:33:43.179104+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:33:43.179104+0000","last_undegraded":"2024-04-25T10:33:43.179104+0000","last_fullsized":"2024-04-25T10:33:43.179104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:30.822807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.186539+0000","last_change":"2024-04-25T10:33:43.181222+0000","last_active":"2024-04-25T10:33:43.186539+0000","last_peered":"2024-04-25T10:33:43.186539+0000","last_clean":"2024-04-25T10:33:43.186539+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:33:43.186539+0000","last_undegraded":"2024-04-25T10:33:43.186539+0000","last_fullsized":"2024-04-25T10:33:43.186539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.181880+0000","last_change":"2024-04-25T10:33:43.175444+0000","last_active":"2024-04-25T10:33:43.181880+0000","last_peered":"2024-04-25T10:33:43.181880+0000","last_clean":"2024-04-25T10:33:43.181880+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:33:43.181880+0000","last_undegraded":"2024-04-25T10:33:43.181880+0000","last_fullsized":"2024-04-25T10:33:43.181880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:16.163417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.191711+0000","last_change":"2024-04-25T10:33:43.186303+0000","last_active":"2024-04-25T10:33:43.191711+0000","last_peered":"2024-04-25T10:33:43.191711+0000","last_clean":"2024-04-25T10:33:43.191711+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:33:43.191711+0000","last_undegraded":"2024-04-25T10:33:43.191711+0000","last_fullsized":"2024-04-25T10:33:43.191711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167768+0000","last_change":"2024-04-25T10:33:43.169919+0000","last_active":"2024-04-25T10:33:44.167768+0000","last_peered":"2024-04-25T10:33:44.167768+0000","last_clean":"2024-04-25T10:33:44.167768+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:33:44.167768+0000","last_undegraded":"2024-04-25T10:33:44.167768+0000","last_fullsized":"2024-04-25T10:33:44.167768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.189354+0000","last_change":"2024-04-25T10:33:43.183760+0000","last_active":"2024-04-25T10:33:43.189354+0000","last_peered":"2024-04-25T10:33:43.189354+0000","last_clean":"2024-04-25T10:33:43.189354+0000","last_became_active":"2024-04-25T10:33:43.183460+0000","last_became_peered":"2024-04-25T10:33:43.183460+0000","last_unstale":"2024-04-25T10:33:43.189354+0000","last_undegraded":"2024-04-25T10:33:43.189354+0000","last_fullsized":"2024-04-25T10:33:43.189354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063510+0000","last_change":"2024-04-25T10:33:43.175552+0000","last_active":"2024-04-25T10:33:45.063510+0000","last_peered":"2024-04-25T10:33:45.063510+0000","last_clean":"2024-04-25T10:33:45.063510+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:33:45.063510+0000","last_undegraded":"2024-04-25T10:33:45.063510+0000","last_fullsized":"2024-04-25T10:33:45.063510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063291+0000","last_change":"2024-04-25T10:33:43.175526+0000","last_active":"2024-04-25T10:33:45.063291+0000","last_peered":"2024-04-25T10:33:45.063291+0000","last_clean":"2024-04-25T10:33:45.063291+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:33:45.063291+0000","last_undegraded":"2024-04-25T10:33:45.063291+0000","last_fullsized":"2024-04-25T10:33:45.063291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168832+0000","last_change":"2024-04-25T10:33:43.176506+0000","last_active":"2024-04-25T10:33:44.168832+0000","last_peered":"2024-04-25T10:33:44.168832+0000","last_clean":"2024-04-25T10:33:44.168832+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:33:44.168832+0000","last_undegraded":"2024-04-25T10:33:44.168832+0000","last_fullsized":"2024-04-25T10:33:44.168832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:54.213946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168167+0000","last_change":"2024-04-25T10:33:43.178091+0000","last_active":"2024-04-25T10:33:44.168167+0000","last_peered":"2024-04-25T10:33:44.168167+0000","last_clean":"2024-04-25T10:33:44.168167+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:33:44.168167+0000","last_undegraded":"2024-04-25T10:33:44.168167+0000","last_fullsized":"2024-04-25T10:33:44.168167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166881+0000","last_change":"2024-04-25T10:33:43.173440+0000","last_active":"2024-04-25T10:33:44.166881+0000","last_peered":"2024-04-25T10:33:44.166881+0000","last_clean":"2024-04-25T10:33:44.166881+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:33:44.166881+0000","last_undegraded":"2024-04-25T10:33:44.166881+0000","last_fullsized":"2024-04-25T10:33:44.166881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.607252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064963+0000","last_change":"2024-04-25T10:33:43.172566+0000","last_active":"2024-04-25T10:33:45.064963+0000","last_peered":"2024-04-25T10:33:45.064963+0000","last_clean":"2024-04-25T10:33:45.064963+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:33:45.064963+0000","last_undegraded":"2024-04-25T10:33:45.064963+0000","last_fullsized":"2024-04-25T10:33:45.064963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.179062+0000","last_change":"2024-04-25T10:33:43.175162+0000","last_active":"2024-04-25T10:33:43.179062+0000","last_peered":"2024-04-25T10:33:43.179062+0000","last_clean":"2024-04-25T10:33:43.179062+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:33:43.179062+0000","last_undegraded":"2024-04-25T10:33:43.179062+0000","last_fullsized":"2024-04-25T10:33:43.179062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.183954+0000","last_change":"2024-04-25T10:33:43.183071+0000","last_active":"2024-04-25T10:33:43.183954+0000","last_peered":"2024-04-25T10:33:43.183954+0000","last_clean":"2024-04-25T10:33:43.183954+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:33:43.183954+0000","last_undegraded":"2024-04-25T10:33:43.183954+0000","last_fullsized":"2024-04-25T10:33:43.183954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.186412+0000","last_change":"2024-04-25T10:33:43.179022+0000","last_active":"2024-04-25T10:33:43.186412+0000","last_peered":"2024-04-25T10:33:43.186412+0000","last_clean":"2024-04-25T10:33:43.186412+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:33:43.186412+0000","last_undegraded":"2024-04-25T10:33:43.186412+0000","last_fullsized":"2024-04-25T10:33:43.186412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:54.213946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.191795+0000","last_change":"2024-04-25T10:33:43.186661+0000","last_active":"2024-04-25T10:33:43.191795+0000","last_peered":"2024-04-25T10:33:43.191795+0000","last_clean":"2024-04-25T10:33:43.191795+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:33:43.191795+0000","last_undegraded":"2024-04-25T10:33:43.191795+0000","last_fullsized":"2024-04-25T10:33:43.191795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:24.341521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063277+0000","last_change":"2024-04-25T10:33:43.175801+0000","last_active":"2024-04-25T10:33:45.063277+0000","last_peered":"2024-04-25T10:33:45.063277+0000","last_clean":"2024-04-25T10:33:45.063277+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:33:45.063277+0000","last_undegraded":"2024-04-25T10:33:45.063277+0000","last_fullsized":"2024-04-25T10:33:45.063277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167037+0000","last_change":"2024-04-25T10:33:43.183056+0000","last_active":"2024-04-25T10:33:44.167037+0000","last_peered":"2024-04-25T10:33:44.167037+0000","last_clean":"2024-04-25T10:33:44.167037+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:33:44.167037+0000","last_undegraded":"2024-04-25T10:33:44.167037+0000","last_fullsized":"2024-04-25T10:33:44.167037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.182217+0000","last_change":"2024-04-25T10:33:43.180388+0000","last_active":"2024-04-25T10:33:43.182217+0000","last_peered":"2024-04-25T10:33:43.182217+0000","last_clean":"2024-04-25T10:33:43.182217+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:33:43.182217+0000","last_undegraded":"2024-04-25T10:33:43.182217+0000","last_fullsized":"2024-04-25T10:33:43.182217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167865+0000","last_change":"2024-04-25T10:33:43.162216+0000","last_active":"2024-04-25T10:33:44.167865+0000","last_peered":"2024-04-25T10:33:44.167865+0000","last_clean":"2024-04-25T10:33:44.167865+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:33:44.167865+0000","last_undegraded":"2024-04-25T10:33:44.167865+0000","last_fullsized":"2024-04-25T10:33:44.167865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.185640+0000","last_change":"2024-04-25T10:33:43.183734+0000","last_active":"2024-04-25T10:33:43.185640+0000","last_peered":"2024-04-25T10:33:43.185640+0000","last_clean":"2024-04-25T10:33:43.185640+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:33:43.185640+0000","last_undegraded":"2024-04-25T10:33:43.185640+0000","last_fullsized":"2024-04-25T10:33:43.185640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168353+0000","last_change":"2024-04-25T10:33:43.167323+0000","last_active":"2024-04-25T10:33:44.168353+0000","last_peered":"2024-04-25T10:33:44.168353+0000","last_clean":"2024-04-25T10:33:44.168353+0000","last_became_active":"2024-04-25T10:33:43.166975+0000","last_became_peered":"2024-04-25T10:33:43.166975+0000","last_unstale":"2024-04-25T10:33:44.168353+0000","last_undegraded":"2024-04-25T10:33:44.168353+0000","last_fullsized":"2024-04-25T10:33:44.168353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063622+0000","last_change":"2024-04-25T10:33:43.183648+0000","last_active":"2024-04-25T10:33:45.063622+0000","last_peered":"2024-04-25T10:33:45.063622+0000","last_clean":"2024-04-25T10:33:45.063622+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:33:45.063622+0000","last_undegraded":"2024-04-25T10:33:45.063622+0000","last_fullsized":"2024-04-25T10:33:45.063622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065076+0000","last_change":"2024-04-25T10:33:43.175229+0000","last_active":"2024-04-25T10:33:45.065076+0000","last_peered":"2024-04-25T10:33:45.065076+0000","last_clean":"2024-04-25T10:33:45.065076+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:33:45.065076+0000","last_undegraded":"2024-04-25T10:33:45.065076+0000","last_fullsized":"2024-04-25T10:33:45.065076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168339+0000","last_change":"2024-04-25T10:33:43.162579+0000","last_active":"2024-04-25T10:33:44.168339+0000","last_peered":"2024-04-25T10:33:44.168339+0000","last_clean":"2024-04-25T10:33:44.168339+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:33:44.168339+0000","last_undegraded":"2024-04-25T10:33:44.168339+0000","last_fullsized":"2024-04-25T10:33:44.168339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167166+0000","last_change":"2024-04-25T10:33:43.168576+0000","last_active":"2024-04-25T10:33:44.167166+0000","last_peered":"2024-04-25T10:33:44.167166+0000","last_clean":"2024-04-25T10:33:44.167166+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:33:44.167166+0000","last_undegraded":"2024-04-25T10:33:44.167166+0000","last_fullsized":"2024-04-25T10:33:44.167166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.183982+0000","last_change":"2024-04-25T10:33:43.182970+0000","last_active":"2024-04-25T10:33:43.183982+0000","last_peered":"2024-04-25T10:33:43.183982+0000","last_clean":"2024-04-25T10:33:43.183982+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:33:43.183982+0000","last_undegraded":"2024-04-25T10:33:43.183982+0000","last_fullsized":"2024-04-25T10:33:43.183982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.184063+0000","last_change":"2024-04-25T10:33:43.171456+0000","last_active":"2024-04-25T10:33:43.184063+0000","last_peered":"2024-04-25T10:33:43.184063+0000","last_clean":"2024-04-25T10:33:43.184063+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:33:43.184063+0000","last_undegraded":"2024-04-25T10:33:43.184063+0000","last_fullsized":"2024-04-25T10:33:43.184063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:19.195134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063096+0000","last_change":"2024-04-25T10:33:43.183419+0000","last_active":"2024-04-25T10:33:45.063096+0000","last_peered":"2024-04-25T10:33:45.063096+0000","last_clean":"2024-04-25T10:33:45.063096+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:33:45.063096+0000","last_undegraded":"2024-04-25T10:33:45.063096+0000","last_fullsized":"2024-04-25T10:33:45.063096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168586+0000","last_change":"2024-04-25T10:33:43.170134+0000","last_active":"2024-04-25T10:33:44.168586+0000","last_peered":"2024-04-25T10:33:44.168586+0000","last_clean":"2024-04-25T10:33:44.168586+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:33:44.168586+0000","last_undegraded":"2024-04-25T10:33:44.168586+0000","last_fullsized":"2024-04-25T10:33:44.168586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:06.463548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168273+0000","last_change":"2024-04-25T10:33:42.162138+0000","last_active":"2024-04-25T10:33:44.168273+0000","last_peered":"2024-04-25T10:33:44.168273+0000","last_clean":"2024-04-25T10:33:44.168273+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:33:44.168273+0000","last_undegraded":"2024-04-25T10:33:44.168273+0000","last_fullsized":"2024-04-25T10:33:44.168273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167155+0000","last_change":"2024-04-25T10:33:43.172141+0000","last_active":"2024-04-25T10:33:44.167155+0000","last_peered":"2024-04-25T10:33:44.167155+0000","last_clean":"2024-04-25T10:33:44.167155+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:33:44.167155+0000","last_undegraded":"2024-04-25T10:33:44.167155+0000","last_fullsized":"2024-04-25T10:33:44.167155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063005+0000","last_change":"2024-04-25T10:33:42.161614+0000","last_active":"2024-04-25T10:33:45.063005+0000","last_peered":"2024-04-25T10:33:45.063005+0000","last_clean":"2024-04-25T10:33:45.063005+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:33:45.063005+0000","last_undegraded":"2024-04-25T10:33:45.063005+0000","last_fullsized":"2024-04-25T10:33:45.063005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167835+0000","last_change":"2024-04-25T10:33:42.158934+0000","last_active":"2024-04-25T10:33:44.167835+0000","last_peered":"2024-04-25T10:33:44.167835+0000","last_clean":"2024-04-25T10:33:44.167835+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:33:44.167835+0000","last_undegraded":"2024-04-25T10:33:44.167835+0000","last_fullsized":"2024-04-25T10:33:44.167835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168337+0000","last_change":"2024-04-25T10:33:43.170270+0000","last_active":"2024-04-25T10:33:44.168337+0000","last_peered":"2024-04-25T10:33:44.168337+0000","last_clean":"2024-04-25T10:33:44.168337+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:33:44.168337+0000","last_undegraded":"2024-04-25T10:33:44.168337+0000","last_fullsized":"2024-04-25T10:33:44.168337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.164278+0000","last_change":"2024-04-25T10:33:42.162167+0000","last_active":"2024-04-25T10:33:43.164278+0000","last_peered":"2024-04-25T10:33:43.164278+0000","last_clean":"2024-04-25T10:33:43.164278+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:33:43.164278+0000","last_undegraded":"2024-04-25T10:33:43.164278+0000","last_fullsized":"2024-04-25T10:33:43.164278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064954+0000","last_change":"2024-04-25T10:33:43.174366+0000","last_active":"2024-04-25T10:33:45.064954+0000","last_peered":"2024-04-25T10:33:45.064954+0000","last_clean":"2024-04-25T10:33:45.064954+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:33:45.064954+0000","last_undegraded":"2024-04-25T10:33:45.064954+0000","last_fullsized":"2024-04-25T10:33:45.064954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063378+0000","last_change":"2024-04-25T10:33:42.163161+0000","last_active":"2024-04-25T10:33:45.063378+0000","last_peered":"2024-04-25T10:33:45.063378+0000","last_clean":"2024-04-25T10:33:45.063378+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:33:45.063378+0000","last_undegraded":"2024-04-25T10:33:45.063378+0000","last_fullsized":"2024-04-25T10:33:45.063378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.181343+0000","last_change":"2024-04-25T10:33:43.179159+0000","last_active":"2024-04-25T10:33:43.181343+0000","last_peered":"2024-04-25T10:33:43.181343+0000","last_clean":"2024-04-25T10:33:43.181343+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:33:43.181343+0000","last_undegraded":"2024-04-25T10:33:43.181343+0000","last_fullsized":"2024-04-25T10:33:43.181343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:42.713890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.163231+0000","last_change":"2024-04-25T10:33:42.168608+0000","last_active":"2024-04-25T10:33:43.163231+0000","last_peered":"2024-04-25T10:33:43.163231+0000","last_clean":"2024-04-25T10:33:43.163231+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:33:43.163231+0000","last_undegraded":"2024-04-25T10:33:43.163231+0000","last_fullsized":"2024-04-25T10:33:43.163231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167316+0000","last_change":"2024-04-25T10:33:43.172553+0000","last_active":"2024-04-25T10:33:44.167316+0000","last_peered":"2024-04-25T10:33:44.167316+0000","last_clean":"2024-04-25T10:33:44.167316+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:33:44.167316+0000","last_undegraded":"2024-04-25T10:33:44.167316+0000","last_fullsized":"2024-04-25T10:33:44.167316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065060+0000","last_change":"2024-04-25T10:33:42.160656+0000","last_active":"2024-04-25T10:33:45.065060+0000","last_peered":"2024-04-25T10:33:45.065060+0000","last_clean":"2024-04-25T10:33:45.065060+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:33:45.065060+0000","last_undegraded":"2024-04-25T10:33:45.065060+0000","last_fullsized":"2024-04-25T10:33:45.065060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:16.669213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168940+0000","last_change":"2024-04-25T10:33:43.178426+0000","last_active":"2024-04-25T10:33:44.168940+0000","last_peered":"2024-04-25T10:33:44.168940+0000","last_clean":"2024-04-25T10:33:44.168940+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:33:44.168940+0000","last_undegraded":"2024-04-25T10:33:44.168940+0000","last_fullsized":"2024-04-25T10:33:44.168940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063183+0000","last_change":"2024-04-25T10:33:42.160251+0000","last_active":"2024-04-25T10:33:45.063183+0000","last_peered":"2024-04-25T10:33:45.063183+0000","last_clean":"2024-04-25T10:33:45.063183+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:33:45.063183+0000","last_undegraded":"2024-04-25T10:33:45.063183+0000","last_fullsized":"2024-04-25T10:33:45.063183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.186883+0000","last_change":"2024-04-25T10:33:43.180666+0000","last_active":"2024-04-25T10:33:43.186883+0000","last_peered":"2024-04-25T10:33:43.186883+0000","last_clean":"2024-04-25T10:33:43.186883+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:33:43.186883+0000","last_undegraded":"2024-04-25T10:33:43.186883+0000","last_fullsized":"2024-04-25T10:33:43.186883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167270+0000","last_change":"2024-04-25T10:33:42.164005+0000","last_active":"2024-04-25T10:33:44.167270+0000","last_peered":"2024-04-25T10:33:44.167270+0000","last_clean":"2024-04-25T10:33:44.167270+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:33:44.167270+0000","last_undegraded":"2024-04-25T10:33:44.167270+0000","last_fullsized":"2024-04-25T10:33:44.167270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:54.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166893+0000","last_change":"2024-04-25T10:33:43.181483+0000","last_active":"2024-04-25T10:33:44.166893+0000","last_peered":"2024-04-25T10:33:44.166893+0000","last_clean":"2024-04-25T10:33:44.166893+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:33:44.166893+0000","last_undegraded":"2024-04-25T10:33:44.166893+0000","last_fullsized":"2024-04-25T10:33:44.166893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:42.713890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.166115+0000","last_change":"2024-04-25T10:33:42.163146+0000","last_active":"2024-04-25T10:33:43.166115+0000","last_peered":"2024-04-25T10:33:43.166115+0000","last_clean":"2024-04-25T10:33:43.166115+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:33:43.166115+0000","last_undegraded":"2024-04-25T10:33:43.166115+0000","last_fullsized":"2024-04-25T10:33:43.166115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.187711+0000","last_change":"2024-04-25T10:33:43.183314+0000","last_active":"2024-04-25T10:33:43.187711+0000","last_peered":"2024-04-25T10:33:43.187711+0000","last_clean":"2024-04-25T10:33:43.187711+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:33:43.187711+0000","last_undegraded":"2024-04-25T10:33:43.187711+0000","last_fullsized":"2024-04-25T10:33:43.187711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.062968+0000","last_change":"2024-04-25T10:33:42.166542+0000","last_active":"2024-04-25T10:33:45.062968+0000","last_peered":"2024-04-25T10:33:45.062968+0000","last_clean":"2024-04-25T10:33:45.062968+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:33:45.062968+0000","last_undegraded":"2024-04-25T10:33:45.062968+0000","last_fullsized":"2024-04-25T10:33:45.062968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063134+0000","last_change":"2024-04-25T10:33:43.176217+0000","last_active":"2024-04-25T10:33:45.063134+0000","last_peered":"2024-04-25T10:33:45.063134+0000","last_clean":"2024-04-25T10:33:45.063134+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:33:45.063134+0000","last_undegraded":"2024-04-25T10:33:45.063134+0000","last_fullsized":"2024-04-25T10:33:45.063134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.186745+0000","last_change":"2024-04-25T10:33:42.156163+0000","last_active":"2024-04-25T10:33:43.186745+0000","last_peered":"2024-04-25T10:33:43.186745+0000","last_clean":"2024-04-25T10:33:43.186745+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:33:43.186745+0000","last_undegraded":"2024-04-25T10:33:43.186745+0000","last_fullsized":"2024-04-25T10:33:43.186745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.186474+0000","last_change":"2024-04-25T10:33:43.183091+0000","last_active":"2024-04-25T10:33:43.186474+0000","last_peered":"2024-04-25T10:33:43.186474+0000","last_clean":"2024-04-25T10:33:43.186474+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:33:43.186474+0000","last_undegraded":"2024-04-25T10:33:43.186474+0000","last_fullsized":"2024-04-25T10:33:43.186474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.169208+0000","last_change":"2024-04-25T10:33:42.162393+0000","last_active":"2024-04-25T10:33:44.169208+0000","last_peered":"2024-04-25T10:33:44.169208+0000","last_clean":"2024-04-25T10:33:44.169208+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:33:44.169208+0000","last_undegraded":"2024-04-25T10:33:44.169208+0000","last_fullsized":"2024-04-25T10:33:44.169208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:57.969551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.186221+0000","last_change":"2024-04-25T10:33:43.183207+0000","last_active":"2024-04-25T10:33:43.186221+0000","last_peered":"2024-04-25T10:33:43.186221+0000","last_clean":"2024-04-25T10:33:43.186221+0000","last_became_active":"2024-04-25T10:33:43.182885+0000","last_became_peered":"2024-04-25T10:33:43.182885+0000","last_unstale":"2024-04-25T10:33:43.186221+0000","last_undegraded":"2024-04-25T10:33:43.186221+0000","last_fullsized":"2024-04-25T10:33:43.186221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.186610+0000","last_change":"2024-04-25T10:33:42.159468+0000","last_active":"2024-04-25T10:33:43.186610+0000","last_peered":"2024-04-25T10:33:43.186610+0000","last_clean":"2024-04-25T10:33:43.186610+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:33:43.186610+0000","last_undegraded":"2024-04-25T10:33:43.186610+0000","last_fullsized":"2024-04-25T10:33:43.186610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.191660+0000","last_change":"2024-04-25T10:33:43.181841+0000","last_active":"2024-04-25T10:33:43.191660+0000","last_peered":"2024-04-25T10:33:43.191660+0000","last_clean":"2024-04-25T10:33:43.191660+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:33:43.191660+0000","last_undegraded":"2024-04-25T10:33:43.191660+0000","last_fullsized":"2024-04-25T10:33:43.191660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065207+0000","last_change":"2024-04-25T10:33:42.152094+0000","last_active":"2024-04-25T10:33:45.065207+0000","last_peered":"2024-04-25T10:33:45.065207+0000","last_clean":"2024-04-25T10:33:45.065207+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:33:45.065207+0000","last_undegraded":"2024-04-25T10:33:45.065207+0000","last_fullsized":"2024-04-25T10:33:45.065207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.924435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.179126+0000","last_change":"2024-04-25T10:33:43.177222+0000","last_active":"2024-04-25T10:33:43.179126+0000","last_peered":"2024-04-25T10:33:43.179126+0000","last_clean":"2024-04-25T10:33:43.179126+0000","last_became_active":"2024-04-25T10:33:43.173582+0000","last_became_peered":"2024-04-25T10:33:43.173582+0000","last_unstale":"2024-04-25T10:33:43.179126+0000","last_undegraded":"2024-04-25T10:33:43.179126+0000","last_fullsized":"2024-04-25T10:33:43.179126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.607252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.168416+0000","last_change":"2024-04-25T10:33:42.167140+0000","last_active":"2024-04-25T10:33:43.168416+0000","last_peered":"2024-04-25T10:33:43.168416+0000","last_clean":"2024-04-25T10:33:43.168416+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:33:43.168416+0000","last_undegraded":"2024-04-25T10:33:43.168416+0000","last_fullsized":"2024-04-25T10:33:43.168416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.189334+0000","last_change":"2024-04-25T10:33:43.184750+0000","last_active":"2024-04-25T10:33:43.189334+0000","last_peered":"2024-04-25T10:33:43.189334+0000","last_clean":"2024-04-25T10:33:43.189334+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:33:43.189334+0000","last_undegraded":"2024-04-25T10:33:43.189334+0000","last_fullsized":"2024-04-25T10:33:43.189334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":108,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.169697+0000","last_change":"2024-04-25T10:33:31.708843+0000","last_active":"2024-04-25T10:33:43.169697+0000","last_peered":"2024-04-25T10:33:43.169697+0000","last_clean":"2024-04-25T10:33:43.169697+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:33:43.169697+0000","last_undegraded":"2024-04-25T10:33:43.169697+0000","last_fullsized":"2024-04-25T10:33:43.169697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_clean_scrub_stamp":"2024-04-25T10:33:30.626866+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:10.475782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.162521+0000","last_change":"2024-04-25T10:33:42.164505+0000","last_active":"2024-04-25T10:33:43.162521+0000","last_peered":"2024-04-25T10:33:43.162521+0000","last_clean":"2024-04-25T10:33:43.162521+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:33:43.162521+0000","last_undegraded":"2024-04-25T10:33:43.162521+0000","last_fullsized":"2024-04-25T10:33:43.162521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167927+0000","last_change":"2024-04-25T10:33:43.169958+0000","last_active":"2024-04-25T10:33:44.167927+0000","last_peered":"2024-04-25T10:33:44.167927+0000","last_clean":"2024-04-25T10:33:44.167927+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:33:44.167927+0000","last_undegraded":"2024-04-25T10:33:44.167927+0000","last_fullsized":"2024-04-25T10:33:44.167927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.169636+0000","last_change":"2024-04-25T10:33:42.163852+0000","last_active":"2024-04-25T10:33:43.169636+0000","last_peered":"2024-04-25T10:33:43.169636+0000","last_clean":"2024-04-25T10:33:43.169636+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:33:43.169636+0000","last_undegraded":"2024-04-25T10:33:43.169636+0000","last_fullsized":"2024-04-25T10:33:43.169636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:28.602376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166780+0000","last_change":"2024-04-25T10:33:43.165039+0000","last_active":"2024-04-25T10:33:44.166780+0000","last_peered":"2024-04-25T10:33:44.166780+0000","last_clean":"2024-04-25T10:33:44.166780+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:33:44.166780+0000","last_undegraded":"2024-04-25T10:33:44.166780+0000","last_fullsized":"2024-04-25T10:33:44.166780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:30.822807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.166593+0000","last_change":"2024-04-25T10:33:42.160012+0000","last_active":"2024-04-25T10:33:43.166593+0000","last_peered":"2024-04-25T10:33:43.166593+0000","last_clean":"2024-04-25T10:33:43.166593+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:33:43.166593+0000","last_undegraded":"2024-04-25T10:33:43.166593+0000","last_fullsized":"2024-04-25T10:33:43.166593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064963+0000","last_change":"2024-04-25T10:33:43.170473+0000","last_active":"2024-04-25T10:33:45.064963+0000","last_peered":"2024-04-25T10:33:45.064963+0000","last_clean":"2024-04-25T10:33:45.064963+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:33:45.064963+0000","last_undegraded":"2024-04-25T10:33:45.064963+0000","last_fullsized":"2024-04-25T10:33:45.064963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.166362+0000","last_change":"2024-04-25T10:33:42.161197+0000","last_active":"2024-04-25T10:33:43.166362+0000","last_peered":"2024-04-25T10:33:43.166362+0000","last_clean":"2024-04-25T10:33:43.166362+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:33:43.166362+0000","last_undegraded":"2024-04-25T10:33:43.166362+0000","last_fullsized":"2024-04-25T10:33:43.166362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168672+0000","last_change":"2024-04-25T10:33:43.172447+0000","last_active":"2024-04-25T10:33:44.168672+0000","last_peered":"2024-04-25T10:33:44.168672+0000","last_clean":"2024-04-25T10:33:44.168672+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:33:44.168672+0000","last_undegraded":"2024-04-25T10:33:44.168672+0000","last_fullsized":"2024-04-25T10:33:44.168672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:19.195134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065155+0000","last_change":"2024-04-25T10:33:42.161100+0000","last_active":"2024-04-25T10:33:45.065155+0000","last_peered":"2024-04-25T10:33:45.065155+0000","last_clean":"2024-04-25T10:33:45.065155+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:33:45.065155+0000","last_undegraded":"2024-04-25T10:33:45.065155+0000","last_fullsized":"2024-04-25T10:33:45.065155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.179424+0000","last_change":"2024-04-25T10:33:43.175361+0000","last_active":"2024-04-25T10:33:43.179424+0000","last_peered":"2024-04-25T10:33:43.179424+0000","last_clean":"2024-04-25T10:33:43.179424+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:33:43.179424+0000","last_undegraded":"2024-04-25T10:33:43.179424+0000","last_fullsized":"2024-04-25T10:33:43.179424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:52.053322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.174149+0000","last_change":"2024-04-25T10:33:42.170292+0000","last_active":"2024-04-25T10:33:43.174149+0000","last_peered":"2024-04-25T10:33:43.174149+0000","last_clean":"2024-04-25T10:33:43.174149+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:33:43.174149+0000","last_undegraded":"2024-04-25T10:33:43.174149+0000","last_fullsized":"2024-04-25T10:33:43.174149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:47.392698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065123+0000","last_change":"2024-04-25T10:33:43.170285+0000","last_active":"2024-04-25T10:33:45.065123+0000","last_peered":"2024-04-25T10:33:45.065123+0000","last_clean":"2024-04-25T10:33:45.065123+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:33:45.065123+0000","last_undegraded":"2024-04-25T10:33:45.065123+0000","last_fullsized":"2024-04-25T10:33:45.065123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.170514+0000","last_change":"2024-04-25T10:33:42.160069+0000","last_active":"2024-04-25T10:33:45.170514+0000","last_peered":"2024-04-25T10:33:45.170514+0000","last_clean":"2024-04-25T10:33:45.170514+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:33:45.170514+0000","last_undegraded":"2024-04-25T10:33:45.170514+0000","last_fullsized":"2024-04-25T10:33:45.170514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168242+0000","last_change":"2024-04-25T10:33:43.181641+0000","last_active":"2024-04-25T10:33:44.168242+0000","last_peered":"2024-04-25T10:33:44.168242+0000","last_clean":"2024-04-25T10:33:44.168242+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:33:44.168242+0000","last_undegraded":"2024-04-25T10:33:44.168242+0000","last_fullsized":"2024-04-25T10:33:44.168242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063445+0000","last_change":"2024-04-25T10:33:42.165706+0000","last_active":"2024-04-25T10:33:45.063445+0000","last_peered":"2024-04-25T10:33:45.063445+0000","last_clean":"2024-04-25T10:33:45.063445+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:33:45.063445+0000","last_undegraded":"2024-04-25T10:33:45.063445+0000","last_fullsized":"2024-04-25T10:33:45.063445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167085+0000","last_change":"2024-04-25T10:33:43.173260+0000","last_active":"2024-04-25T10:33:44.167085+0000","last_peered":"2024-04-25T10:33:44.167085+0000","last_clean":"2024-04-25T10:33:44.167085+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:33:44.167085+0000","last_undegraded":"2024-04-25T10:33:44.167085+0000","last_fullsized":"2024-04-25T10:33:44.167085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.169485+0000","last_change":"2024-04-25T10:33:42.166946+0000","last_active":"2024-04-25T10:33:43.169485+0000","last_peered":"2024-04-25T10:33:43.169485+0000","last_clean":"2024-04-25T10:33:43.169485+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:33:43.169485+0000","last_undegraded":"2024-04-25T10:33:43.169485+0000","last_fullsized":"2024-04-25T10:33:43.169485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:29.817932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168855+0000","last_change":"2024-04-25T10:33:43.170510+0000","last_active":"2024-04-25T10:33:44.168855+0000","last_peered":"2024-04-25T10:33:44.168855+0000","last_clean":"2024-04-25T10:33:44.168855+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:33:44.168855+0000","last_undegraded":"2024-04-25T10:33:44.168855+0000","last_fullsized":"2024-04-25T10:33:44.168855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065073+0000","last_change":"2024-04-25T10:33:42.165204+0000","last_active":"2024-04-25T10:33:45.065073+0000","last_peered":"2024-04-25T10:33:45.065073+0000","last_clean":"2024-04-25T10:33:45.065073+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:33:45.065073+0000","last_undegraded":"2024-04-25T10:33:45.065073+0000","last_fullsized":"2024-04-25T10:33:45.065073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167946+0000","last_change":"2024-04-25T10:33:43.168088+0000","last_active":"2024-04-25T10:33:44.167946+0000","last_peered":"2024-04-25T10:33:44.167946+0000","last_clean":"2024-04-25T10:33:44.167946+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:33:44.167946+0000","last_undegraded":"2024-04-25T10:33:44.167946+0000","last_fullsized":"2024-04-25T10:33:44.167946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065140+0000","last_change":"2024-04-25T10:33:42.156381+0000","last_active":"2024-04-25T10:33:45.065140+0000","last_peered":"2024-04-25T10:33:45.065140+0000","last_clean":"2024-04-25T10:33:45.065140+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:33:45.065140+0000","last_undegraded":"2024-04-25T10:33:45.065140+0000","last_fullsized":"2024-04-25T10:33:45.065140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168277+0000","last_change":"2024-04-25T10:33:43.167502+0000","last_active":"2024-04-25T10:33:44.168277+0000","last_peered":"2024-04-25T10:33:44.168277+0000","last_clean":"2024-04-25T10:33:44.168277+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:33:44.168277+0000","last_undegraded":"2024-04-25T10:33:44.168277+0000","last_fullsized":"2024-04-25T10:33:44.168277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.191956+0000","last_change":"2024-04-25T10:33:42.168840+0000","last_active":"2024-04-25T10:33:43.191956+0000","last_peered":"2024-04-25T10:33:43.191956+0000","last_clean":"2024-04-25T10:33:43.191956+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:33:43.191956+0000","last_undegraded":"2024-04-25T10:33:43.191956+0000","last_fullsized":"2024-04-25T10:33:43.191956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:51.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063081+0000","last_change":"2024-04-25T10:33:43.174672+0000","last_active":"2024-04-25T10:33:45.063081+0000","last_peered":"2024-04-25T10:33:45.063081+0000","last_clean":"2024-04-25T10:33:45.063081+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:33:45.063081+0000","last_undegraded":"2024-04-25T10:33:45.063081+0000","last_fullsized":"2024-04-25T10:33:45.063081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.181215+0000","last_change":"2024-04-25T10:33:43.179274+0000","last_active":"2024-04-25T10:33:43.181215+0000","last_peered":"2024-04-25T10:33:43.181215+0000","last_clean":"2024-04-25T10:33:43.181215+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:33:43.181215+0000","last_undegraded":"2024-04-25T10:33:43.181215+0000","last_fullsized":"2024-04-25T10:33:43.181215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.192032+0000","last_change":"2024-04-25T10:33:42.168654+0000","last_active":"2024-04-25T10:33:43.192032+0000","last_peered":"2024-04-25T10:33:43.192032+0000","last_clean":"2024-04-25T10:33:43.192032+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:33:43.192032+0000","last_undegraded":"2024-04-25T10:33:43.192032+0000","last_fullsized":"2024-04-25T10:33:43.192032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:15.158541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.177003+0000","last_change":"2024-04-25T10:33:43.170923+0000","last_active":"2024-04-25T10:33:43.177003+0000","last_peered":"2024-04-25T10:33:43.177003+0000","last_clean":"2024-04-25T10:33:43.177003+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:33:43.177003+0000","last_undegraded":"2024-04-25T10:33:43.177003+0000","last_fullsized":"2024-04-25T10:33:43.177003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T10:33:43.191916+0000","last_change":"2024-04-25T10:33:42.171374+0000","last_active":"2024-04-25T10:33:43.191916+0000","last_peered":"2024-04-25T10:33:43.191916+0000","last_clean":"2024-04-25T10:33:43.191916+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:33:43.191916+0000","last_undegraded":"2024-04-25T10:33:43.191916+0000","last_fullsized":"2024-04-25T10:33:43.191916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:41.709015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167209+0000","last_change":"2024-04-25T10:33:43.172788+0000","last_active":"2024-04-25T10:33:44.167209+0000","last_peered":"2024-04-25T10:33:44.167209+0000","last_clean":"2024-04-25T10:33:44.167209+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:33:44.167209+0000","last_undegraded":"2024-04-25T10:33:44.167209+0000","last_fullsized":"2024-04-25T10:33:44.167209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168142+0000","last_change":"2024-04-25T10:33:42.161364+0000","last_active":"2024-04-25T10:33:44.168142+0000","last_peered":"2024-04-25T10:33:44.168142+0000","last_clean":"2024-04-25T10:33:44.168142+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:33:44.168142+0000","last_undegraded":"2024-04-25T10:33:44.168142+0000","last_fullsized":"2024-04-25T10:33:44.168142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168175+0000","last_change":"2024-04-25T10:33:43.177654+0000","last_active":"2024-04-25T10:33:44.168175+0000","last_peered":"2024-04-25T10:33:44.168175+0000","last_clean":"2024-04-25T10:33:44.168175+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:33:44.168175+0000","last_undegraded":"2024-04-25T10:33:44.168175+0000","last_fullsized":"2024-04-25T10:33:44.168175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167339+0000","last_change":"2024-04-25T10:33:42.167156+0000","last_active":"2024-04-25T10:33:44.167339+0000","last_peered":"2024-04-25T10:33:44.167339+0000","last_clean":"2024-04-25T10:33:44.167339+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:33:44.167339+0000","last_undegraded":"2024-04-25T10:33:44.167339+0000","last_fullsized":"2024-04-25T10:33:44.167339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":64794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:33:46.529 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:33:46.529 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T10:33:46.529 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T10:33:46.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T10:33:46.529 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T10:33:46.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.671+0000 7f71e626e640 1 Processor -- start 2024-04-25T10:33:46.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.671+0000 7f71e626e640 1 -- start start 2024-04-25T10:33:46.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.672+0000 7f71e626e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e0068bd0 0x7f71e00b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.672+0000 7f71e626e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f71e00b9330 0x7f71e0149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.672+0000 7f71e626e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e014a5f0 con 0x7f71e014a1e0 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.672+0000 7f71e626e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f71e006ce60 con 0x7f71e00b9330 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.672+0000 7f71e626e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f71e006c9d0 con 0x7f71e0068bd0 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.673+0000 7f71df7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f71e00b9330 0x7f71e0149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.673+0000 7f71df7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f71e00b9330 0x7f71e0149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48566/0 (socket says 172.21.15.103:48566) 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.673+0000 7f71df7fe640 1 -- 172.21.15.103:0/2833652383 learned_addr learned my addr 172.21.15.103:0/2833652383 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.673+0000 7f71dffff640 1 --2- 172.21.15.103:0/2833652383 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e0068bd0 0x7f71e00b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.673+0000 7f71df7fe640 1 -- 172.21.15.103:0/2833652383 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e0068bd0 msgr2=0x7f71e00b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:46.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.673+0000 7f71df7fe640 1 --2- 172.21.15.103:0/2833652383 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e0068bd0 0x7f71e00b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.673+0000 7f71df7fe640 1 -- 172.21.15.103:0/2833652383 >> v1:172.21.15.132:6789/0 conn(0x7f71e014a1e0 legacy=0x7f71e014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.673+0000 7f71df7fe640 1 -- 172.21.15.103:0/2833652383 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e006d5a0 con 0x7f71e00b9330 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.674+0000 7f71df7fe640 1 --2- 172.21.15.103:0/2833652383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e00b9330 0x7f71e0149ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009870 tx=0x7f71d402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3925dc02e4c1511 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.674+0000 7f71deffd640 1 -- 172.21.15.103:0/2833652383 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4037070 con 0x7f71e00b9330 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.674+0000 7f71deffd640 1 -- 172.21.15.103:0/2833652383 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d4032440 con 0x7f71e00b9330 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.674+0000 7f71deffd640 1 -- 172.21.15.103:0/2833652383 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4032810 con 0x7f71e00b9330 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.674+0000 7f71e626e640 1 -- 172.21.15.103:0/2833652383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e00b9330 msgr2=0x7f71e0149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.674+0000 7f71e626e640 1 --2- 172.21.15.103:0/2833652383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e00b9330 0x7f71e0149ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009870 tx=0x7f71d402a1c0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.675+0000 7f71e626e640 1 -- 172.21.15.103:0/2833652383 shutdown_connections 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.675+0000 7f71e626e640 1 --2- 172.21.15.103:0/2833652383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e00b9330 0x7f71e0149ca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.675+0000 7f71e626e640 1 --2- 172.21.15.103:0/2833652383 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e0068bd0 0x7f71e00b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.675+0000 7f71e626e640 1 -- 172.21.15.103:0/2833652383 >> 172.21.15.103:0/2833652383 conn(0x7f71e00a0100 msgr2=0x7f71e00a0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:46.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.675+0000 7f71e626e640 1 -- 172.21.15.103:0/2833652383 shutdown_connections 2024-04-25T10:33:46.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.675+0000 7f71e626e640 1 -- 172.21.15.103:0/2833652383 wait complete. 2024-04-25T10:33:46.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.676+0000 7f71e626e640 1 Processor -- start 2024-04-25T10:33:46.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.676+0000 7f71e626e640 1 -- start start 2024-04-25T10:33:46.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e626e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e0068bd0 0x7f71e01cf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e626e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e00b9330 0x7f71e01d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e626e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e014a1e0 0x7f71e0145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e626e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71e006eef0 con 0x7f71e014a1e0 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e626e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f71e0068fe0 con 0x7f71e0068bd0 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e626e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f71e006c660 con 0x7f71e00b9330 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e480b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e014a1e0 0x7f71e0145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e480b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e014a1e0 0x7f71e0145b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48578/0 (socket says 172.21.15.103:48578) 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71e480b640 1 -- 172.21.15.103:0/2720784879 learned_addr learned my addr 172.21.15.103:0/2720784879 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71df7fe640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e00b9330 0x7f71e01d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.677+0000 7f71dffff640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e0068bd0 0x7f71e01cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71e480b640 1 -- 172.21.15.103:0/2720784879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e00b9330 msgr2=0x7f71e01d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71e480b640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e00b9330 0x7f71e01d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71e480b640 1 -- 172.21.15.103:0/2720784879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e0068bd0 msgr2=0x7f71e01cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71e480b640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e0068bd0 0x7f71e01cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71e480b640 1 -- 172.21.15.103:0/2720784879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e01d1330 con 0x7f71e014a1e0 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71e480b640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e014a1e0 0x7f71e0145b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c6e0 tx=0x7f71d800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71dcff9640 1 -- 172.21.15.103:0/2720784879 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8003b70 con 0x7f71e014a1e0 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71dcff9640 1 -- 172.21.15.103:0/2720784879 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d8003d30 con 0x7f71e014a1e0 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e01d09d0 con 0x7f71e014a1e0 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71dcff9640 1 -- 172.21.15.103:0/2720784879 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d8005310 con 0x7f71e014a1e0 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.678+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e00b5270 con 0x7f71e014a1e0 2024-04-25T10:33:46.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.679+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e01d1140 con 0x7f71e014a1e0 2024-04-25T10:33:46.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.679+0000 7f71dcff9640 1 -- 172.21.15.103:0/2720784879 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f71d80054b0 con 0x7f71e014a1e0 2024-04-25T10:33:46.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.680+0000 7f71dcff9640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f71cc0744e0 0x7f71cc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:46.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.680+0000 7f71dffff640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f71cc0744e0 0x7f71cc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:46.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.680+0000 7f71dcff9640 1 -- 172.21.15.103:0/2720784879 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f71d8095010 con 0x7f71e014a1e0 2024-04-25T10:33:46.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.680+0000 7f71dffff640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f71cc0744e0 0x7f71cc0769f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71e0070ec0 tx=0x7f71d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:46.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.685+0000 7f71dcff9640 1 -- 172.21.15.103:0/2720784879 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f71e014a5f0 con 0x7f71e014a1e0 2024-04-25T10:33:46.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.906+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f71e006a130 con 0x7f71e014a1e0 2024-04-25T10:33:46.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.909+0000 7f71dcff9640 1 -- 172.21.15.103:0/2720784879 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186750 (secure 0 0 0) 0x7f71d805f830 con 0x7f71e014a1e0 2024-04-25T10:33:46.912 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f71cc0744e0 msgr2=0x7f71cc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f71cc0744e0 0x7f71cc0769f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71e0070ec0 tx=0x7f71d0008040 comp rx=0 tx=0).stop 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e014a1e0 msgr2=0x7f71e0145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e014a1e0 0x7f71e0145b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c6e0 tx=0x7f71d800cba0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 shutdown_connections 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f71cc0744e0 0x7f71cc0769f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71e014a1e0 0x7f71e0145b40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f71e00b9330 0x7f71e01d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 --2- 172.21.15.103:0/2720784879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71e0068bd0 0x7f71e01cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 >> 172.21.15.103:0/2720784879 conn(0x7f71e00a0100 msgr2=0x7f71e0072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:46.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 shutdown_connections 2024-04-25T10:33:46.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:46.912+0000 7f71e626e640 1 -- 172.21.15.103:0/2720784879 wait complete. 2024-04-25T10:33:46.924 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1879218478},{"type":"v1","addr":"172.21.15.103:6833","nonce":1879218478}]},"active_addr":"172.21.15.103:6833/1879218478","active_change":"2024-04-25T10:33:22.481210+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":4204947891}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1002963576}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3118668531}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3630091371}]}]} 2024-04-25T10:33:46.927 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T10:33:46.927 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T10:33:46.928 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:47.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.033+0000 7f9909334640 1 Processor -- start 2024-04-25T10:33:47.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.033+0000 7f9909334640 1 -- start start 2024-04-25T10:33:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f9909334640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9904143960 0x7f9904149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f9909334640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f99040be4c0 0x7f99040bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f9909334640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99040bda00 con 0x7f990406d2d0 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f9909334640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f99040be030 con 0x7f99040be4c0 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f9909334640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f99041499c0 con 0x7f9904143960 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f99027fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f99040be4c0 0x7f99040bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f99027fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f99040be4c0 0x7f99040bbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48594/0 (socket says 172.21.15.103:48594) 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f99027fc640 1 -- 172.21.15.103:0/180136505 learned_addr learned my addr 172.21.15.103:0/180136505 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.034+0000 7f9902ffd640 1 --2- 172.21.15.103:0/180136505 >> v2:172.21.15.132:3300/0 conn(0x7f9904143960 0x7f9904149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f99027fc640 1 -- 172.21.15.103:0/180136505 >> v2:172.21.15.132:3300/0 conn(0x7f9904143960 msgr2=0x7f9904149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f99027fc640 1 --2- 172.21.15.103:0/180136505 >> v2:172.21.15.132:3300/0 conn(0x7f9904143960 0x7f9904149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f99027fc640 1 -- 172.21.15.103:0/180136505 >> v1:172.21.15.132:6789/0 conn(0x7f990406d2d0 legacy=0x7f990406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f99027fc640 1 -- 172.21.15.103:0/180136505 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99040bdcc0 con 0x7f99040be4c0 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f9902ffd640 1 --2- 172.21.15.103:0/180136505 >> v2:172.21.15.132:3300/0 conn(0x7f9904143960 0x7f9904149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:47.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f99027fc640 1 --2- 172.21.15.103:0/180136505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99040be4c0 0x7f99040bbb00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f99040be1b0 tx=0x7f98f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a425127d6b3004b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f9901ffb640 1 -- 172.21.15.103:0/180136505 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8037070 con 0x7f99040be4c0 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f9901ffb640 1 -- 172.21.15.103:0/180136505 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f8032440 con 0x7f99040be4c0 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.035+0000 7f9901ffb640 1 -- 172.21.15.103:0/180136505 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8032810 con 0x7f99040be4c0 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.036+0000 7f9909334640 1 -- 172.21.15.103:0/180136505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99040be4c0 msgr2=0x7f99040bbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.036+0000 7f9909334640 1 --2- 172.21.15.103:0/180136505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99040be4c0 0x7f99040bbb00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f99040be1b0 tx=0x7f98f802a1e0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.036+0000 7f9909334640 1 -- 172.21.15.103:0/180136505 shutdown_connections 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.036+0000 7f9909334640 1 --2- 172.21.15.103:0/180136505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99040be4c0 0x7f99040bbb00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.036+0000 7f9909334640 1 --2- 172.21.15.103:0/180136505 >> v2:172.21.15.132:3300/0 conn(0x7f9904143960 0x7f9904149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.036+0000 7f9909334640 1 -- 172.21.15.103:0/180136505 >> 172.21.15.103:0/180136505 conn(0x7f99040befa0 msgr2=0x7f99040bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.036+0000 7f9909334640 1 -- 172.21.15.103:0/180136505 shutdown_connections 2024-04-25T10:33:47.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.036+0000 7f9909334640 1 -- 172.21.15.103:0/180136505 wait complete. 2024-04-25T10:33:47.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.038+0000 7f9909334640 1 Processor -- start 2024-04-25T10:33:47.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.038+0000 7f9909334640 1 -- start start 2024-04-25T10:33:47.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9909334640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f990406d2d0 0x7f990414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9909334640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040be4c0 0x7f99041e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9909334640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9904143960 0x7f99041df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9909334640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9904153f20 con 0x7f9904143960 2024-04-25T10:33:47.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9909334640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9904153da0 con 0x7f99040be4c0 2024-04-25T10:33:47.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9909334640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f99041540a0 con 0x7f990406d2d0 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9904143960 0x7f99041df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9904143960 0x7f99041df7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48608/0 (socket says 172.21.15.103:48608) 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 -- 172.21.15.103:0/2933420321 learned_addr learned my addr 172.21.15.103:0/2933420321 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9902ffd640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f990406d2d0 0x7f990414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99027fc640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040be4c0 0x7f99041e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 -- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f990406d2d0 msgr2=0x7f990414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f990406d2d0 0x7f990414cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 -- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040be4c0 msgr2=0x7f99041e2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040be4c0 0x7f99041e2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 -- 172.21.15.103:0/2933420321 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99040b4c40 con 0x7f9904143960 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99027fc640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040be4c0 0x7f99041e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f99037fe640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9904143960 0x7f99041df7e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c3c0 tx=0x7f98fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f98eb7fe640 1 -- 172.21.15.103:0/2933420321 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc017070 con 0x7f9904143960 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f98eb7fe640 1 -- 172.21.15.103:0/2933420321 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98fc0052d0 con 0x7f9904143960 2024-04-25T10:33:47.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99041e3320 con 0x7f9904143960 2024-04-25T10:33:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f98eb7fe640 1 -- 172.21.15.103:0/2933420321 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc003810 con 0x7f9904143960 2024-04-25T10:33:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.039+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99041e3530 con 0x7f9904143960 2024-04-25T10:33:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.041+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9904076350 con 0x7f9904143960 2024-04-25T10:33:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.041+0000 7f98eb7fe640 1 -- 172.21.15.103:0/2933420321 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f98fc01a070 con 0x7f9904143960 2024-04-25T10:33:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.042+0000 7f98eb7fe640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98f00744b0 0x7f98f00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.042+0000 7f98eb7fe640 1 -- 172.21.15.103:0/2933420321 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f98fc0944d0 con 0x7f9904143960 2024-04-25T10:33:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.042+0000 7f9902ffd640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98f00744b0 0x7f98f00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.042+0000 7f9902ffd640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98f00744b0 0x7f98f00769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99040b93e0 tx=0x7f98f400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.046+0000 7f98eb7fe640 1 -- 172.21.15.103:0/2933420321 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9904076350 con 0x7f9904143960 2024-04-25T10:33:47.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.227+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99041df1b0 con 0x7f9904143960 2024-04-25T10:33:47.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.228+0000 7f98eb7fe640 1 -- 172.21.15.103:0/2933420321 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16665 (secure 0 0 0) 0x7f99041df1b0 con 0x7f9904143960 2024-04-25T10:33:47.229 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:47.230 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:44.163567+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:47.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98f00744b0 msgr2=0x7f98f00769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98f00744b0 0x7f98f00769c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99040b93e0 tx=0x7f98f400b040 comp rx=0 tx=0).stop 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9904143960 msgr2=0x7f99041df7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9904143960 0x7f99041df7e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c3c0 tx=0x7f98fc00c880 comp rx=0 tx=0).stop 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 shutdown_connections 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f98f00744b0 0x7f98f00769c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9904143960 0x7f99041df7e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99040be4c0 0x7f99041e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 --2- 172.21.15.103:0/2933420321 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f990406d2d0 0x7f990414cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 >> 172.21.15.103:0/2933420321 conn(0x7f99040befa0 msgr2=0x7f99040bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 shutdown_connections 2024-04-25T10:33:47.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.230+0000 7f9909334640 1 -- 172.21.15.103:0/2933420321 wait complete. 2024-04-25T10:33:47.242 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T10:33:47.243 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.349+0000 7f2e8a8f2640 1 Processor -- start 2024-04-25T10:33:47.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.349+0000 7f2e8a8f2640 1 -- start start 2024-04-25T10:33:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e8a8f2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e840b3210 0x7f2e8406d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e8a8f2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b4ed0 0x7f2e84141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e8a8f2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e840b8b40 con 0x7f2e840b52e0 2024-04-25T10:33:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e8a8f2640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2e840b8de0 con 0x7f2e840b3210 2024-04-25T10:33:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e8a8f2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f2e840b3f80 con 0x7f2e840b4ed0 2024-04-25T10:33:47.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e83fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e840b3210 0x7f2e8406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e83fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2e840b3210 0x7f2e8406d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48624/0 (socket says 172.21.15.103:48624) 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e83fff640 1 -- 172.21.15.103:0/561895837 learned_addr learned my addr 172.21.15.103:0/561895837 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e837fe640 1 --2- 172.21.15.103:0/561895837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b4ed0 0x7f2e84141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e83fff640 1 -- 172.21.15.103:0/561895837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b4ed0 msgr2=0x7f2e84141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e83fff640 1 --2- 172.21.15.103:0/561895837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b4ed0 0x7f2e84141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e83fff640 1 -- 172.21.15.103:0/561895837 >> v1:172.21.15.132:6789/0 conn(0x7f2e840b52e0 legacy=0x7f2e8414aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e83fff640 1 -- 172.21.15.103:0/561895837 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e840b4340 con 0x7f2e840b3210 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.350+0000 7f2e837fe640 1 --2- 172.21.15.103:0/561895837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b4ed0 0x7f2e84141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.351+0000 7f2e83fff640 1 --2- 172.21.15.103:0/561895837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8406d870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009850 tx=0x7f2e7402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6deb8b6b51dd0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.351+0000 7f2e82ffd640 1 -- 172.21.15.103:0/561895837 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7402ade0 con 0x7f2e840b3210 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.351+0000 7f2e82ffd640 1 -- 172.21.15.103:0/561895837 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e74004030 con 0x7f2e840b3210 2024-04-25T10:33:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.351+0000 7f2e82ffd640 1 -- 172.21.15.103:0/561895837 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74004460 con 0x7f2e840b3210 2024-04-25T10:33:47.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.352+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/561895837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 msgr2=0x7f2e8406d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.352+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/561895837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8406d870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009850 tx=0x7f2e7402a0d0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.352+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/561895837 shutdown_connections 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.352+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/561895837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b4ed0 0x7f2e84141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.352+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/561895837 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8406d870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.352+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/561895837 >> 172.21.15.103:0/561895837 conn(0x7f2e840bd040 msgr2=0x7f2e840b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.352+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/561895837 shutdown_connections 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.352+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/561895837 wait complete. 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.353+0000 7f2e8a8f2640 1 Processor -- start 2024-04-25T10:33:47.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.353+0000 7f2e8a8f2640 1 -- start start 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e8a8f2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8413d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e8a8f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e840b4ed0 0x7f2e84136940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e8a8f2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b52e0 0x7f2e841e0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e8a8f2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84141790 con 0x7f2e840b3210 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e8a8f2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2e840b4100 con 0x7f2e840b4ed0 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e8a8f2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f2e84141910 con 0x7f2e840b52e0 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e83fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8413d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e83fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8413d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48636/0 (socket says 172.21.15.103:48636) 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.354+0000 7f2e83fff640 1 -- 172.21.15.103:0/2578757537 learned_addr learned my addr 172.21.15.103:0/2578757537 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e83fff640 1 -- 172.21.15.103:0/2578757537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b52e0 msgr2=0x7f2e841e0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e83fff640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b52e0 0x7f2e841e0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e83fff640 1 -- 172.21.15.103:0/2578757537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e840b4ed0 msgr2=0x7f2e84136940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e83fff640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e840b4ed0 0x7f2e84136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e83fff640 1 -- 172.21.15.103:0/2578757537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e841dd220 con 0x7f2e840b3210 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e83fff640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8413d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e74034040 tx=0x7f2e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e80ff9640 1 -- 172.21.15.103:0/2578757537 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74041020 con 0x7f2e840b3210 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e80ff9640 1 -- 172.21.15.103:0/2578757537 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e74003820 con 0x7f2e840b3210 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e80ff9640 1 -- 172.21.15.103:0/2578757537 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74003c10 con 0x7f2e840b3210 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e841dd4e0 con 0x7f2e840b3210 2024-04-25T10:33:47.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.355+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e841489d0 con 0x7f2e840b3210 2024-04-25T10:33:47.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.356+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8406a130 con 0x7f2e840b3210 2024-04-25T10:33:47.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.357+0000 7f2e80ff9640 1 -- 172.21.15.103:0/2578757537 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2e74044020 con 0x7f2e840b3210 2024-04-25T10:33:47.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.357+0000 7f2e80ff9640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2e700744e0 0x7f2e700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.357+0000 7f2e837fe640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2e700744e0 0x7f2e700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.357+0000 7f2e80ff9640 1 -- 172.21.15.103:0/2578757537 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2e740b5b10 con 0x7f2e840b3210 2024-04-25T10:33:47.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.358+0000 7f2e837fe640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2e700744e0 0x7f2e700769f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006fd0 tx=0x7f2e78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.362+0000 7f2e80ff9640 1 -- 172.21.15.103:0/2578757537 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e7404b030 con 0x7f2e840b3210 2024-04-25T10:33:47.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.536+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e8414b900 con 0x7f2e840b3210 2024-04-25T10:33:47.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.538+0000 7f2e80ff9640 1 -- 172.21.15.103:0/2578757537 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16665 (secure 0 0 0) 0x7f2e740802b0 con 0x7f2e840b3210 2024-04-25T10:33:47.539 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:47.539 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:44.163567+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:47.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.539+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2e700744e0 msgr2=0x7f2e700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.539+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2e700744e0 0x7f2e700769f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e78006fd0 tx=0x7f2e78008040 comp rx=0 tx=0).stop 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.539+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 msgr2=0x7f2e8413d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.539+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8413d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e74034040 tx=0x7f2e740046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.540+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 shutdown_connections 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.540+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f2e700744e0 0x7f2e700769f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.540+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2e840b52e0 0x7f2e841e0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.540+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e840b4ed0 0x7f2e84136940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.540+0000 7f2e8a8f2640 1 --2- 172.21.15.103:0/2578757537 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e840b3210 0x7f2e8413d1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.540+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 >> 172.21.15.103:0/2578757537 conn(0x7f2e840bd040 msgr2=0x7f2e840b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.540+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 shutdown_connections 2024-04-25T10:33:47.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.540+0000 7f2e8a8f2640 1 -- 172.21.15.103:0/2578757537 wait complete. 2024-04-25T10:33:47.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T10:33:47.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T10:33:47.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T10:33:47.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T10:33:47.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T10:33:47.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T10:33:47.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T10:33:47.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T10:33:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.760+0000 7fb381938640 1 Processor -- start 2024-04-25T10:33:47.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.760+0000 7feb5759e640 1 Processor -- start 2024-04-25T10:33:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.760+0000 7feb5759e640 1 -- start start 2024-04-25T10:33:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.760+0000 7fb381938640 1 -- start start 2024-04-25T10:33:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.761+0000 7feaebfff640 1 Processor -- start 2024-04-25T10:33:47.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.761+0000 7feaebfff640 1 -- start start 2024-04-25T10:33:47.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.761+0000 7f795ca42640 1 Processor -- start 2024-04-25T10:33:47.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7fb381938640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb37c148d70 0x7fb37c0b7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7feb5759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb580b2aa0 0x7feb5806f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7f7491d91640 1 Processor -- start 2024-04-25T10:33:47.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7feb5759e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feb580b3e10 0x7feb580b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7feb5759e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb580b17d0 con 0x7feb581410c0 2024-04-25T10:33:47.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaebfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feae40cb530 0x7feae4037870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaebfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaebfff640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae402b280 con 0x7feae402a0f0 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaebfff640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7feae402b560 con 0x7feae40cb530 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaebfff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7feae402b840 con 0x7feae402ab30 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7feb5759e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7feb580b2610 con 0x7feb580b3e10 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7feb5759e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7feb580b6420 con 0x7feb580b2aa0 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7feb55d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feb580b3e10 0x7feb580b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feb55d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feb580b3e10 0x7feb580b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48648/0 (socket says 172.21.15.103:48648) 2024-04-25T10:33:47.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feb55d9b640 1 -- 172.21.15.103:0/1419591635 learned_addr learned my addr 172.21.15.103:0/1419591635 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7fb37affd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb37c148d70 0x7fb37c0b7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7fb37affd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb37c148d70 0x7fb37c0b7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48650/0 (socket says 172.21.15.103:48650) 2024-04-25T10:33:47.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7fb37affd640 1 -- 172.21.15.103:0/2229132181 learned_addr learned my addr 172.21.15.103:0/2229132181 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7fb381938640 1 --2- 172.21.15.103:0/2229132181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c06c870 0x7fb37c0b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaeb7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7f7491d91640 1 -- start start 2024-04-25T10:33:47.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaeb7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:45834/0 (socket says 172.21.15.103:45834) 2024-04-25T10:33:47.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1653160987 learned_addr learned my addr 172.21.15.103:0/1653160987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feb55d9b640 1 -- 172.21.15.103:0/1419591635 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb580b2aa0 msgr2=0x7feb5806f8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:47.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feb55d9b640 1 --2- 172.21.15.103:0/1419591635 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb580b2aa0 0x7feb5806f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feb55d9b640 1 -- 172.21.15.103:0/1419591635 >> v1:172.21.15.132:6789/0 conn(0x7feb581410c0 legacy=0x7feb58147100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:47.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7f43610e2640 1 Processor -- start 2024-04-25T10:33:47.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.762+0000 7f795ca42640 1 -- start start 2024-04-25T10:33:47.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7fb37a7fc640 1 --2- 172.21.15.103:0/2229132181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c06c870 0x7fb37c0b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feb55d9b640 1 -- 172.21.15.103:0/1419591635 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb580b6700 con 0x7feb580b3e10 2024-04-25T10:33:47.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7f2110934640 1 Processor -- start 2024-04-25T10:33:47.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1653160987 >> v2:172.21.15.103:3300/0 conn(0x7feae40cb530 msgr2=0x7feae4037870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:47.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaeb7fe640 1 --2- 172.21.15.103:0/1653160987 >> v2:172.21.15.103:3300/0 conn(0x7feae40cb530 0x7feae4037870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1653160987 >> v1:172.21.15.132:6789/0 conn(0x7feae402a0f0 legacy=0x7feae40cae20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:47.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7f77f3935640 1 Processor -- start 2024-04-25T10:33:47.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f77f3935640 1 -- start start 2024-04-25T10:33:47.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f795ca42640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79580b45f0 0x7f79580b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f795ca42640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7958073c30 con 0x7f7958071da0 2024-04-25T10:33:47.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f795ca42640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7958073150 con 0x7f79580b1290 2024-04-25T10:33:47.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f795ca42640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f79580721b0 con 0x7f79580b45f0 2024-04-25T10:33:47.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb381938640 1 -- 172.21.15.103:0/2229132181 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37c06c630 con 0x7fb37c06d9c0 2024-04-25T10:33:47.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb381938640 1 -- 172.21.15.103:0/2229132181 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb37c0b5f40 con 0x7fb37c148d70 2024-04-25T10:33:47.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb379ffb640 1 -- 172.21.15.103:0/2229132181 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198043533 0 0) 0x7fb37c06c630 con 0x7fb37c06d9c0 2024-04-25T10:33:47.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb381938640 1 -- 172.21.15.103:0/2229132181 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c0b77f0 con 0x7fb37c06c870 2024-04-25T10:33:47.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7f2110934640 1 -- start start 2024-04-25T10:33:47.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1653160987 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae40c4cf0 con 0x7feae402ab30 2024-04-25T10:33:47.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb379ffb640 1 -- 172.21.15.103:0/2229132181 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb364004630 con 0x7fb37c06d9c0 2024-04-25T10:33:47.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f7491d91640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f748c1519e0 0x7f748c071730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f7955d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79580b45f0 0x7f79580b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f7955d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79580b45f0 0x7f79580b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58572/0 (socket says 172.21.15.103:58572) 2024-04-25T10:33:47.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f7955d9b640 1 -- 172.21.15.103:0/2750645772 learned_addr learned my addr 172.21.15.103:0/2750645772 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f7491d91640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb37a7fc640 1 -- 172.21.15.103:0/2229132181 >> v2:172.21.15.103:3300/0 conn(0x7fb37c148d70 msgr2=0x7fb37c0b7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb37a7fc640 1 --2- 172.21.15.103:0/2229132181 >> v2:172.21.15.103:3300/0 conn(0x7fb37c148d70 0x7fb37c0b7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb37a7fc640 1 -- 172.21.15.103:0/2229132181 >> v1:172.21.15.103:6789/0 conn(0x7fb37c06d9c0 legacy=0x7fb37c13f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f7491d91640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f748c0b5570 con 0x7f748c147480 2024-04-25T10:33:47.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f7491d91640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f748c151550 con 0x7f748c1519e0 2024-04-25T10:33:47.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7f7491d91640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f748c0732e0 con 0x7f748c072ed0 2024-04-25T10:33:47.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.764+0000 7fb37a7fc640 1 -- 172.21.15.103:0/2229132181 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c0b5980 con 0x7fb37c06c870 2024-04-25T10:33:47.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f7491590640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f748c147480 0x7f748c147890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.103:47912/0 (socket says 172.21.15.103:47912) 2024-04-25T10:33:47.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f7491590640 1 -- 172.21.15.103:0/1867220766 learned_addr learned my addr 172.21.15.103:0/1867220766 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:47.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f748bfff640 1 --2- 172.21.15.103:0/1867220766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846220663 0 0) 0x7f7958073150 con 0x7f79580b1290 2024-04-25T10:33:47.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.763+0000 7f43610e2640 1 -- start start 2024-04-25T10:33:47.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7940003520 con 0x7f79580b1290 2024-04-25T10:33:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f43610e2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c071720 0x7f435c13f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f43610e2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f435c146260 0x7f435c0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f43610e2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f435c145650 con 0x7f435c145e50 2024-04-25T10:33:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f43610e2640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f435c145930 con 0x7f435c146260 2024-04-25T10:33:47.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f43610e2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f435c0b0900 con 0x7f435c071720 2024-04-25T10:33:47.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7feaeb7fe640 1 --2- 172.21.15.103:0/1653160987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c47b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feae0009870 tx=0x7feae002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe11bd0f84e36bba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f435ad9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c071720 0x7f435c13f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f435b59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f435c146260 0x7f435c0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f2110934640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f21040385b0 0x7f21040cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f2110934640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040cc9a0 0x7f21040c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f2110934640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210402a470 con 0x7f2104039000 2024-04-25T10:33:47.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f435b59e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f435c146260 0x7f435c0b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48676/0 (socket says 172.21.15.103:48676) 2024-04-25T10:33:47.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f2110934640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2104037f40 con 0x7f21040385b0 2024-04-25T10:33:47.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f2110934640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f2104039410 con 0x7f21040cc9a0 2024-04-25T10:33:47.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f435b59e640 1 -- 172.21.15.103:0/1612430894 learned_addr learned my addr 172.21.15.103:0/1612430894 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f77f3935640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f77ec142e10 0x7f77ec148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3226402477 0 0) 0x7f7940003520 con 0x7f79580b1290 2024-04-25T10:33:47.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 >> v2:172.21.15.132:3300/0 conn(0x7f79580b45f0 msgr2=0x7f79580b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f77f16d1640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f77ec0afb70 0x7f77ec142700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33044/0 (socket says 172.21.15.103:33044) 2024-04-25T10:33:47.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f210bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040cc9a0 0x7f21040c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f210b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2104039000 0x7f2104036080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33056/0 (socket says 172.21.15.103:33056) 2024-04-25T10:33:47.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f210b7fe640 1 -- 172.21.15.103:0/1863939034 learned_addr learned my addr 172.21.15.103:0/1863939034 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:47.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f210affd640 1 --2- 172.21.15.103:0/1863939034 >> v2:172.21.15.132:3300/0 conn(0x7f21040385b0 0x7f21040cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7feae9ffb640 1 -- 172.21.15.103:0/1653160987 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0037070 con 0x7feae402ab30 2024-04-25T10:33:47.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77f3935640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ec0b12e0 con 0x7f77ec0afb70 2024-04-25T10:33:47.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77f3935640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ec0b15c0 con 0x7f77ec0b4f90 2024-04-25T10:33:47.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77f16d1640 1 -- 172.21.15.103:0/2828411308 learned_addr learned my addr 172.21.15.103:0/2828411308 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:47.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77f3935640 1 -- 172.21.15.103:0/2828411308 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f77ec143220 con 0x7f77ec142e10 2024-04-25T10:33:47.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7feae9ffb640 1 -- 172.21.15.103:0/1653160987 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae0032440 con 0x7feae402ab30 2024-04-25T10:33:47.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7feae9ffb640 1 -- 172.21.15.103:0/1653160987 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0032810 con 0x7feae402ab30 2024-04-25T10:33:47.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77f1ed2640 1 --2- 172.21.15.103:0/2828411308 >> v2:172.21.15.132:3300/0 conn(0x7f77ec142e10 0x7f77ec148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 --2- 172.21.15.103:0/2750645772 >> v2:172.21.15.132:3300/0 conn(0x7f79580b45f0 0x7f79580b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7fb37a7fc640 1 --2- 172.21.15.103:0/2229132181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c06c870 0x7fb37c0b72b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0b60c0 tx=0x7fb37002a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b33d9eeb5825379f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 >> v1:172.21.15.103:6789/0 conn(0x7f7958071da0 legacy=0x7f7958150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f748b7fe640 1 -- 172.21.15.103:0/1867220766 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750910715 0 0) 0x7f748c0b5570 con 0x7f748c147480 2024-04-25T10:33:47.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f748b7fe640 1 -- 172.21.15.103:0/1867220766 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7474003520 con 0x7f748c147480 2024-04-25T10:33:47.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.765+0000 7f748bfff640 1 -- 172.21.15.103:0/1867220766 >> v2:172.21.15.103:3300/0 conn(0x7f748c1519e0 msgr2=0x7f748c071730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:47.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f748b7fe640 1 -- 172.21.15.103:0/1867220766 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2320905617 0 0) 0x7f7474003520 con 0x7f748c147480 2024-04-25T10:33:47.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f7490d8f640 1 --2- 172.21.15.103:0/1867220766 >> v2:172.21.15.103:3300/0 conn(0x7f748c1519e0 0x7f748c071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f4359d9b640 1 -- 172.21.15.103:0/1612430894 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929657451 0 0) 0x7f435c145650 con 0x7f435c145e50 2024-04-25T10:33:47.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f4359d9b640 1 -- 172.21.15.103:0/1612430894 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4344003520 con 0x7f435c145e50 2024-04-25T10:33:47.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f435ad9d640 1 -- 172.21.15.103:0/1612430894 >> v2:172.21.15.103:3300/0 conn(0x7f435c146260 msgr2=0x7f435c0b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f435ad9d640 1 --2- 172.21.15.103:0/1612430894 >> v2:172.21.15.103:3300/0 conn(0x7f435c146260 0x7f435c0b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f435ad9d640 1 -- 172.21.15.103:0/1612430894 >> v1:172.21.15.132:6789/0 conn(0x7f435c145e50 legacy=0x7f435c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f435ad9d640 1 -- 172.21.15.103:0/1612430894 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c0b4f90 con 0x7f435c071720 2024-04-25T10:33:47.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7958073430 con 0x7f79580b1290 2024-04-25T10:33:47.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f210affd640 1 -- 172.21.15.103:0/1863939034 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040cc9a0 msgr2=0x7f21040c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f210affd640 1 --2- 172.21.15.103:0/1863939034 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040cc9a0 0x7f21040c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f794c001670 con 0x7f79580b1290 2024-04-25T10:33:47.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f210affd640 1 -- 172.21.15.103:0/1863939034 >> v1:172.21.15.103:6789/0 conn(0x7f2104039000 legacy=0x7f2104036080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f210affd640 1 -- 172.21.15.103:0/1863939034 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21040378f0 con 0x7f21040385b0 2024-04-25T10:33:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 >> v1:172.21.15.132:6789/0 conn(0x7f79580b1290 legacy=0x7f79580b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7940003a00 0x7f7940003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77e3fff640 1 -- 172.21.15.103:0/2828411308 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91869304 0 0) 0x7f77ec0b12e0 con 0x7f77ec0afb70 2024-04-25T10:33:47.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77e3fff640 1 -- 172.21.15.103:0/2828411308 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77d8003520 con 0x7f77ec0afb70 2024-04-25T10:33:47.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77f1ed2640 1 -- 172.21.15.103:0/2828411308 >> v1:172.21.15.132:6789/0 conn(0x7f77ec0b4f90 legacy=0x7f77ec14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77f1ed2640 1 -- 172.21.15.103:0/2828411308 >> v1:172.21.15.103:6789/0 conn(0x7f77ec0afb70 legacy=0x7f77ec142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f77f1ed2640 1 -- 172.21.15.103:0/2828411308 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec0b6df0 con 0x7f77ec142e10 2024-04-25T10:33:47.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7940004800 0x7f7940004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f794000ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79580721b0 con 0x7f7940004800 2024-04-25T10:33:47.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f795659c640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7940003a00 0x7f7940003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f794000c2e0 con 0x7f7940005350 2024-04-25T10:33:47.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f794000c4e0 con 0x7f7940003a00 2024-04-25T10:33:47.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f7956d9d640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f794000ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f748bfff640 1 --2- 172.21.15.103:0/1867220766 >> v2:172.21.15.103:3300/0 conn(0x7f748c1519e0 0x7f748c071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f748bfff640 1 -- 172.21.15.103:0/1867220766 >> v1:172.21.15.132:6789/0 conn(0x7f748c147480 legacy=0x7f748c147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.766+0000 7f748bfff640 1 -- 172.21.15.103:0/1867220766 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c150f40 con 0x7f748c072ed0 2024-04-25T10:33:47.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f7490d8f640 1 --2- 172.21.15.103:0/1867220766 >> v2:172.21.15.103:3300/0 conn(0x7f748c1519e0 0x7f748c071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:47.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f7955d9b640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7940004800 0x7f7940004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7feaebfff640 1 -- 172.21.15.103:0/1653160987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 msgr2=0x7feae40c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7feaebfff640 1 --2- 172.21.15.103:0/1653160987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c47b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feae0009870 tx=0x7feae002a1a0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7fb379ffb640 1 -- 172.21.15.103:0/2229132181 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370037070 con 0x7fb37c06c870 2024-04-25T10:33:47.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7fb379ffb640 1 -- 172.21.15.103:0/2229132181 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37002ae40 con 0x7fb37c06c870 2024-04-25T10:33:47.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7fb379ffb640 1 -- 172.21.15.103:0/2229132181 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370032660 con 0x7fb37c06c870 2024-04-25T10:33:47.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f7956d9d640 1 -- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7940003a00 msgr2=0x7f7940003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f7956d9d640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7940003a00 0x7f7940003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f435ad9d640 1 --2- 172.21.15.103:0/1612430894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c071720 0x7f435c13f5b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097a0 tx=0x7f434c02a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb6504db7cd9d40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f7956d9d640 1 -- 172.21.15.103:0/2750645772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7940004800 msgr2=0x7f7940004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:47.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f7956d9d640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7940004800 0x7f7940004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f748bfff640 1 --2- 172.21.15.103:0/1867220766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c0b5030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7484009d90 tx=0x7f748402a4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8483cfd4c1762465 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f7956d9d640 1 -- 172.21.15.103:0/2750645772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7940003520 con 0x7f7940005350 2024-04-25T10:33:47.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f77f1ed2640 1 --2- 172.21.15.103:0/2828411308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 0x7f77ec148eb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009d90 tx=0x7f77e402a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f5a5545c9c0e0a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7feb55d9b640 1 --2- 172.21.15.103:0/1419591635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb580b3e10 0x7feb580b1290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00f9b0 tx=0x7feb4c02e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09c2f42f957b4b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7feaebfff640 1 -- 172.21.15.103:0/1653160987 shutdown_connections 2024-04-25T10:33:47.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7feaebfff640 1 --2- 172.21.15.103:0/1653160987 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c47b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7feaebfff640 1 --2- 172.21.15.103:0/1653160987 >> v2:172.21.15.103:3300/0 conn(0x7feae40cb530 0x7feae4037870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7feaebfff640 1 -- 172.21.15.103:0/1653160987 >> 172.21.15.103:0/1653160987 conn(0x7feae403b6c0 msgr2=0x7feae40064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f210affd640 1 --2- 172.21.15.103:0/1863939034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040385b0 0x7f21040cc460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f20f80097a0 tx=0x7f20f802a010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dca611da43276b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f77e3fff640 1 -- 172.21.15.103:0/2828411308 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4007740 con 0x7f77ec142e10 2024-04-25T10:33:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7feaebfff640 1 -- 172.21.15.103:0/1653160987 shutdown_connections 2024-04-25T10:33:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f748b7fe640 1 -- 172.21.15.103:0/1867220766 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7480001650 con 0x7f748c072ed0 2024-04-25T10:33:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f748b7fe640 1 -- 172.21.15.103:0/1867220766 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7484007540 con 0x7f748c072ed0 2024-04-25T10:33:47.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f748b7fe640 1 -- 172.21.15.103:0/1867220766 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484007910 con 0x7f748c072ed0 2024-04-25T10:33:47.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f77e3fff640 1 -- 172.21.15.103:0/2828411308 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e40078e0 con 0x7f77ec142e10 2024-04-25T10:33:47.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f77e3fff640 1 -- 172.21.15.103:0/2828411308 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e4007c90 con 0x7f77ec142e10 2024-04-25T10:33:47.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7feaebfff640 1 -- 172.21.15.103:0/1653160987 wait complete. 2024-04-25T10:33:47.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f210a7fc640 1 -- 172.21.15.103:0/1863939034 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8037070 con 0x7f21040385b0 2024-04-25T10:33:47.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f210a7fc640 1 -- 172.21.15.103:0/1863939034 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f802ad20 con 0x7f21040385b0 2024-04-25T10:33:47.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f210a7fc640 1 -- 172.21.15.103:0/1863939034 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8032660 con 0x7f21040385b0 2024-04-25T10:33:47.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7feb5559a640 1 -- 172.21.15.103:0/1419591635 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c03a070 con 0x7feb580b3e10 2024-04-25T10:33:47.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7feb5559a640 1 -- 172.21.15.103:0/1419591635 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c033710 con 0x7feb580b3e10 2024-04-25T10:33:47.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7feb5559a640 1 -- 172.21.15.103:0/1419591635 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c033ae0 con 0x7feb580b3e10 2024-04-25T10:33:47.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f4359d9b640 1 -- 172.21.15.103:0/1612430894 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c037070 con 0x7f435c071720 2024-04-25T10:33:47.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f4359d9b640 1 -- 172.21.15.103:0/1612430894 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434c02ad20 con 0x7f435c071720 2024-04-25T10:33:47.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.767+0000 7f4359d9b640 1 -- 172.21.15.103:0/1612430894 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c032660 con 0x7f435c071720 2024-04-25T10:33:47.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7fb381938640 1 -- 172.21.15.103:0/2229132181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c06c870 msgr2=0x7fb37c0b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7fb381938640 1 --2- 172.21.15.103:0/2229132181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c06c870 0x7fb37c0b72b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb37c0b60c0 tx=0x7fb37002a0f0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f7956d9d640 1 -- 172.21.15.103:0/2750645772 reap_dead start 2024-04-25T10:33:47.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.768+0000 7f7956d9d640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f794000ba00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f794c007f40 tx=0x7f7940005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=391735836118805f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7fb381938640 1 -- 172.21.15.103:0/2229132181 shutdown_connections 2024-04-25T10:33:47.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7fb381938640 1 --2- 172.21.15.103:0/2229132181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c06c870 0x7fb37c0b72b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7fb381938640 1 --2- 172.21.15.103:0/2229132181 >> v2:172.21.15.103:3300/0 conn(0x7fb37c148d70 0x7fb37c0b7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7fb381938640 1 -- 172.21.15.103:0/2229132181 >> 172.21.15.103:0/2229132181 conn(0x7fb37c09ff70 msgr2=0x7fb37c0a0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c007b90 con 0x7f7940005350 2024-04-25T10:33:47.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7fb381938640 1 -- 172.21.15.103:0/2229132181 shutdown_connections 2024-04-25T10:33:47.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7fb381938640 1 -- 172.21.15.103:0/2229132181 wait complete. 2024-04-25T10:33:47.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f794c031620 con 0x7f7940005350 2024-04-25T10:33:47.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f43610e2640 1 -- 172.21.15.103:0/1612430894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c071720 msgr2=0x7f435c13f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f43610e2640 1 --2- 172.21.15.103:0/1612430894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c071720 0x7f435c13f5b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f434c0097a0 tx=0x7f434c02a010 comp rx=0 tx=0).stop 2024-04-25T10:33:47.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f795559a640 1 -- 172.21.15.103:0/2750645772 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c031a10 con 0x7f7940005350 2024-04-25T10:33:47.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f77f3935640 1 -- 172.21.15.103:0/2828411308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 msgr2=0x7f77ec148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f77f3935640 1 --2- 172.21.15.103:0/2828411308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 0x7f77ec148eb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009d90 tx=0x7f77e402a590 comp rx=0 tx=0).stop 2024-04-25T10:33:47.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f2110934640 1 -- 172.21.15.103:0/1863939034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040385b0 msgr2=0x7f21040cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f2110934640 1 --2- 172.21.15.103:0/1863939034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040385b0 0x7f21040cc460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f20f80097a0 tx=0x7f20f802a010 comp rx=0 tx=0).stop 2024-04-25T10:33:47.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f7491d91640 1 -- 172.21.15.103:0/1867220766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 msgr2=0x7f748c0b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f7491d91640 1 --2- 172.21.15.103:0/1867220766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c0b5030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7484009d90 tx=0x7f748402a4e0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f77f3935640 1 -- 172.21.15.103:0/2828411308 shutdown_connections 2024-04-25T10:33:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f43610e2640 1 -- 172.21.15.103:0/1612430894 shutdown_connections 2024-04-25T10:33:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f43610e2640 1 --2- 172.21.15.103:0/1612430894 >> v2:172.21.15.103:3300/0 conn(0x7f435c146260 0x7f435c0b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f43610e2640 1 --2- 172.21.15.103:0/1612430894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c071720 0x7f435c13f5b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f43610e2640 1 -- 172.21.15.103:0/1612430894 >> 172.21.15.103:0/1612430894 conn(0x7f435c0b77a0 msgr2=0x7f435c0ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f77f3935640 1 --2- 172.21.15.103:0/2828411308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 0x7f77ec148eb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f77f3935640 1 -- 172.21.15.103:0/2828411308 >> 172.21.15.103:0/2828411308 conn(0x7f77ec0b7c10 msgr2=0x7f77ec0ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f2110934640 1 -- 172.21.15.103:0/1863939034 shutdown_connections 2024-04-25T10:33:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f2110934640 1 --2- 172.21.15.103:0/1863939034 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040cc9a0 0x7f21040c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f2110934640 1 --2- 172.21.15.103:0/1863939034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040385b0 0x7f21040cc460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f2110934640 1 -- 172.21.15.103:0/1863939034 >> 172.21.15.103:0/1863939034 conn(0x7f210403b270 msgr2=0x7f2104006090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f7491d91640 1 -- 172.21.15.103:0/1867220766 shutdown_connections 2024-04-25T10:33:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f7491d91640 1 --2- 172.21.15.103:0/1867220766 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c0b5030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f7491d91640 1 --2- 172.21.15.103:0/1867220766 >> v2:172.21.15.103:3300/0 conn(0x7f748c1519e0 0x7f748c071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f7491d91640 1 -- 172.21.15.103:0/1867220766 >> 172.21.15.103:0/1867220766 conn(0x7f748c0bb060 msgr2=0x7f748c06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f7491d91640 1 -- 172.21.15.103:0/1867220766 shutdown_connections 2024-04-25T10:33:47.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f77f3935640 1 -- 172.21.15.103:0/2828411308 shutdown_connections 2024-04-25T10:33:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f7491d91640 1 -- 172.21.15.103:0/1867220766 wait complete. 2024-04-25T10:33:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.769+0000 7f77f3935640 1 -- 172.21.15.103:0/2828411308 wait complete. 2024-04-25T10:33:47.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f795ca42640 1 -- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 msgr2=0x7f794000ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f795ca42640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f794000ba00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f794c007f40 tx=0x7f7940005830 comp rx=0 tx=0).stop 2024-04-25T10:33:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7feb5759e640 1 -- 172.21.15.103:0/1419591635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb580b3e10 msgr2=0x7feb580b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7feb5759e640 1 --2- 172.21.15.103:0/1419591635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb580b3e10 0x7feb580b1290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00f9b0 tx=0x7feb4c02e530 comp rx=0 tx=0).stop 2024-04-25T10:33:47.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f795ca42640 1 -- 172.21.15.103:0/2750645772 shutdown_connections 2024-04-25T10:33:47.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f795ca42640 1 --2- 172.21.15.103:0/2750645772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f794000ba00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7feaebfff640 1 Processor -- start 2024-04-25T10:33:47.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f795ca42640 1 -- 172.21.15.103:0/2750645772 >> 172.21.15.103:0/2750645772 conn(0x7f795806d150 msgr2=0x7f79580baa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f795ca42640 1 -- 172.21.15.103:0/2750645772 shutdown_connections 2024-04-25T10:33:47.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f43610e2640 1 -- 172.21.15.103:0/1612430894 shutdown_connections 2024-04-25T10:33:47.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f795ca42640 1 -- 172.21.15.103:0/2750645772 wait complete. 2024-04-25T10:33:47.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.771+0000 7f2110934640 1 -- 172.21.15.103:0/1863939034 shutdown_connections 2024-04-25T10:33:47.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7f43610e2640 1 -- 172.21.15.103:0/1612430894 wait complete. 2024-04-25T10:33:47.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.770+0000 7feaebfff640 1 -- start start 2024-04-25T10:33:47.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.771+0000 7fb381938640 1 Processor -- start 2024-04-25T10:33:47.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.771+0000 7f2110934640 1 -- 172.21.15.103:0/1863939034 wait complete. 2024-04-25T10:33:47.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.771+0000 7feb5759e640 1 -- 172.21.15.103:0/1419591635 shutdown_connections 2024-04-25T10:33:47.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.771+0000 7feb5759e640 1 --2- 172.21.15.103:0/1419591635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb580b3e10 0x7feb580b1290 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.771+0000 7feb5759e640 1 --2- 172.21.15.103:0/1419591635 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb580b2aa0 0x7feb5806f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7feb5759e640 1 -- 172.21.15.103:0/1419591635 >> 172.21.15.103:0/1419591635 conn(0x7feb580b7550 msgr2=0x7feb580b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7f77f3935640 1 Processor -- start 2024-04-25T10:33:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7fb381938640 1 -- start start 2024-04-25T10:33:47.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7f77f3935640 1 -- start start 2024-04-25T10:33:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7feaebfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae402a0f0 0x7feae415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7feb5759e640 1 -- 172.21.15.103:0/1419591635 shutdown_connections 2024-04-25T10:33:47.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7f7491d91640 1 Processor -- start 2024-04-25T10:33:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7feaebfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7f7491d91640 1 -- start start 2024-04-25T10:33:47.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7feaebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae40cb530 0x7feae40bd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7feaebfff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feae4035480 con 0x7feae40cb530 2024-04-25T10:33:47.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7feaeb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae40cb530 0x7feae40bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7feaeb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae40cb530 0x7feae40bd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48686/0 (socket says 172.21.15.103:48686) 2024-04-25T10:33:47.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1410220969 learned_addr learned my addr 172.21.15.103:0/1410220969 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7feaea7fc640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7feaeaffd640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae402a0f0 0x7feae415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7feae40c51d0 con 0x7feae402a0f0 2024-04-25T10:33:47.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7feae4035600 con 0x7feae402ab30 2024-04-25T10:33:47.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7f795ca42640 1 Processor -- start 2024-04-25T10:33:47.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7f795ca42640 1 -- start start 2024-04-25T10:33:47.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.773+0000 7fb381938640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb37c06c870 0x7fb37c1402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.772+0000 7feb5759e640 1 -- 172.21.15.103:0/1419591635 wait complete. 2024-04-25T10:33:47.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f3935640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77ec0afb70 0x7f77ec0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f3935640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77ec0b4f90 0x7f77ec1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7fb37affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb37c06c870 0x7fb37c1402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7fb37affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb37c06c870 0x7fb37c1402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48702/0 (socket says 172.21.15.103:48702) 2024-04-25T10:33:47.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f2110934640 1 Processor -- start 2024-04-25T10:33:47.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7fb381938640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb37c06d9c0 0x7fb37c1dddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f16d1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77ec0afb70 0x7f77ec0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f2110934640 1 -- start start 2024-04-25T10:33:47.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f16d1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77ec0afb70 0x7f77ec0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:45910/0 (socket says 172.21.15.103:45910) 2024-04-25T10:33:47.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f16d1640 1 -- 172.21.15.103:0/2941530379 learned_addr learned my addr 172.21.15.103:0/2941530379 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f0ed0640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77ec0b4f90 0x7f77ec1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f3935640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 0x7f77ec0b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7fb37affd640 1 -- 172.21.15.103:0/2708723377 learned_addr learned my addr 172.21.15.103:0/2708723377 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1410220969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 msgr2=0x7feae40c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7feaeb7fe640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feae402ab30 0x7feae40c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1410220969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae402a0f0 msgr2=0x7feae415ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7feaeb7fe640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feae402a0f0 0x7feae415ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1410220969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae415e9e0 con 0x7feae40cb530 2024-04-25T10:33:47.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec06fdf0 con 0x7f77ec0b4f90 2024-04-25T10:33:47.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec072570 con 0x7f77ec142e10 2024-04-25T10:33:47.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f77ec06ff70 con 0x7f77ec0afb70 2024-04-25T10:33:47.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f7491d91640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c1424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7fb381938640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c148d70 0x7fb37c09d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f7491d91640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c147480 0x7f748c13ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f7491d91640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1519e0 0x7f748c140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f7491d91640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f748c0b6e90 con 0x7f748c1519e0 2024-04-25T10:33:47.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f7491d91640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f748c147fa0 con 0x7f748c147480 2024-04-25T10:33:47.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f7491d91640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f748c072220 con 0x7f748c072ed0 2024-04-25T10:33:47.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7feb5759e640 1 Processor -- start 2024-04-25T10:33:47.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f795ca42640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f795814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f7490d8f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c1424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7f7490d8f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c1424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:45912/0 (socket says 172.21.15.103:45912) 2024-04-25T10:33:47.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f7490d8f640 1 -- 172.21.15.103:0/4276662360 learned_addr learned my addr 172.21.15.103:0/4276662360 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7feaeb7fe640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae40cb530 0x7feae40bd180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feae0009870 tx=0x7feae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f7491590640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1519e0 0x7f748c140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795ca42640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f795814eb00 0x7f795814ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f748bfff640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c147480 0x7f748c13ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7feb5759e640 1 -- start start 2024-04-25T10:33:47.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f1ed2640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 0x7f77ec0b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f795814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f795814fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58646/0 (socket says 172.21.15.103:58646) 2024-04-25T10:33:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795659c640 1 -- 172.21.15.103:0/1041115896 learned_addr learned my addr 172.21.15.103:0/1041115896 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f16d1640 1 -- 172.21.15.103:0/2941530379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 msgr2=0x7f77ec0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f16d1640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 0x7f77ec0b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f16d1640 1 -- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77ec0b4f90 msgr2=0x7f77ec1455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f16d1640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77ec0b4f90 0x7f77ec1455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f43610e2640 1 Processor -- start 2024-04-25T10:33:47.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795ca42640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7958143390 0x7f79581437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f7955d9b640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f795814eb00 0x7f795814ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795ca42640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79580b4b80 con 0x7f7958143390 2024-04-25T10:33:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f43610e2640 1 -- start start 2024-04-25T10:33:47.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f16d1640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec13cc10 con 0x7f77ec0afb70 2024-04-25T10:33:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795ca42640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f79580b4a00 con 0x7f7940005350 2024-04-25T10:33:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795ca42640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f79580b4d00 con 0x7f795814eb00 2024-04-25T10:33:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f1ed2640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77ec142e10 0x7f77ec0b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f0ed0640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77ec0b4f90 0x7f77ec1455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:47.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f77f16d1640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77ec0afb70 0x7f77ec0b1b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f77e800c3c0 tx=0x7f77e800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f7956d9d640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7958143390 0x7f79581437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f7490d8f640 1 -- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c147480 msgr2=0x7f748c13ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f7490d8f640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c147480 0x7f748c13ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f7490d8f640 1 -- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1519e0 msgr2=0x7f748c140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f7490d8f640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1519e0 0x7f748c140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795659c640 1 -- 172.21.15.103:0/1041115896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f795814eb00 msgr2=0x7f795814ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795659c640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f795814eb00 0x7f795814ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795659c640 1 -- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7958143390 msgr2=0x7f79581437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795659c640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7958143390 0x7f79581437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7f795659c640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7958150110 con 0x7f7940005350 2024-04-25T10:33:47.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f7490d8f640 1 -- 172.21.15.103:0/4276662360 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c1409d0 con 0x7f748c072ed0 2024-04-25T10:33:47.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f7956d9d640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7958143390 0x7f79581437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:47.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f795659c640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f795814fbd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7948001050 tx=0x7f794800e910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f2110934640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040385b0 0x7f210403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f2110934640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2104039000 0x7f21040b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80074e0 con 0x7f77ec0afb70 2024-04-25T10:33:47.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e8007680 con 0x7f77ec0afb70 2024-04-25T10:33:47.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f2110934640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040cc9a0 0x7f21040b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040385b0 0x7f210403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f2110934640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2104036790 con 0x7f2104039000 2024-04-25T10:33:47.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f2110934640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f21040ccdb0 con 0x7f21040cc9a0 2024-04-25T10:33:47.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f2110934640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f21040c3120 con 0x7f21040385b0 2024-04-25T10:33:47.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f210affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2104039000 0x7f21040b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040385b0 0x7f210403bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:45938/0 (socket says 172.21.15.103:45938) 2024-04-25T10:33:47.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f210b7fe640 1 -- 172.21.15.103:0/3825561244 learned_addr learned my addr 172.21.15.103:0/3825561244 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f7490d8f640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c1424c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c820 tx=0x7f747c00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f210bfff640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040cc9a0 0x7f21040b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f43610e2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f435c071720 0x7f435c13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e80049e0 con 0x7f77ec0afb70 2024-04-25T10:33:47.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79480052e0 con 0x7f7940005350 2024-04-25T10:33:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb5759e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb580b2aa0 0x7feb58148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c13ff40 con 0x7fb37c06c870 2024-04-25T10:33:47.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f795ca42640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79580b05e0 con 0x7f7940005350 2024-04-25T10:33:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb5759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580b3e10 0x7feb581db790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.774+0000 7fb37bfff640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c148d70 0x7fb37c09d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb5759e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb581410c0 0x7feb58072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f795ca42640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7958151bb0 con 0x7f7940005350 2024-04-25T10:33:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb5759e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feb581414d0 con 0x7feb580b2aa0 2024-04-25T10:33:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb5759e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7feb580b4220 con 0x7feb580b3e10 2024-04-25T10:33:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb5759e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7feb58141650 con 0x7feb581410c0 2024-04-25T10:33:47.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f7491590640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f748c1519e0 0x7f748c140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:47.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7f748bfff640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f748c147480 0x7f748c13ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:47.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7fb37a7fc640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb37c06d9c0 0x7fb37c1dddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb55d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580b3e10 0x7feb581db790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0041070 con 0x7feae40cb530 2024-04-25T10:33:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae003c930 con 0x7feae40cb530 2024-04-25T10:33:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0037040 con 0x7feae40cb530 2024-04-25T10:33:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7948018070 con 0x7f7940005350 2024-04-25T10:33:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae415f3d0 con 0x7feae40cb530 2024-04-25T10:33:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.775+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae40c2450 con 0x7feae40cb530 2024-04-25T10:33:47.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7fead17fa640 1 -- 172.21.15.103:0/1410220969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feac4001030 con 0x7feae40cb530 2024-04-25T10:33:47.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb5659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb580b2aa0 0x7feb58148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb55d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580b3e10 0x7feb581db790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58660/0 (socket says 172.21.15.103:58660) 2024-04-25T10:33:47.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb55d9b640 1 -- 172.21.15.103:0/3523732724 learned_addr learned my addr 172.21.15.103:0/3523732724 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79480037f0 con 0x7f7940005350 2024-04-25T10:33:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb56d9d640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb581410c0 0x7feb58072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb55d9b640 1 -- 172.21.15.103:0/3523732724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb581410c0 msgr2=0x7feb58072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7feb55d9b640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb581410c0 0x7feb58072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7feb55d9b640 1 -- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb580b2aa0 msgr2=0x7feb58148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7feb55d9b640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb580b2aa0 0x7feb58148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7feb55d9b640 1 -- 172.21.15.103:0/3523732724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb581dbcd0 con 0x7feb580b3e10 2024-04-25T10:33:47.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7feb56d9d640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feb581410c0 0x7feb58072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f43610e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435c145e50 0x7f435c1de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f43610e2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c146260 0x7f435c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f43610e2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f435c13fc70 con 0x7f435c071720 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f43610e2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f435c13faf0 con 0x7f435c145e50 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f43610e2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f435c0b7be0 con 0x7f435c146260 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435b59e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c146260 0x7f435c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435c145e50 0x7f435c1de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435c145e50 0x7f435c1de4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58676/0 (socket says 172.21.15.103:58676) 2024-04-25T10:33:47.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435a59c640 1 -- 172.21.15.103:0/1860659141 learned_addr learned my addr 172.21.15.103:0/1860659141 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c13fdc0 con 0x7fb37c06d9c0 2024-04-25T10:33:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c068cd0 con 0x7fb37c148d70 2024-04-25T10:33:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f210bfff640 1 -- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040385b0 msgr2=0x7f210403bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f210bfff640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040385b0 0x7f210403bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f210bfff640 1 -- 172.21.15.103:0/3825561244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2104039000 msgr2=0x7f21040b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f210bfff640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2104039000 0x7f21040b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f210bfff640 1 -- 172.21.15.103:0/3825561244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210403d140 con 0x7f21040cc9a0 2024-04-25T10:33:47.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7f210b7fe640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21040385b0 0x7f210403bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7fb37bfff640 1 -- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb37c06d9c0 msgr2=0x7fb37c1dddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7fb37bfff640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb37c06d9c0 0x7fb37c1dddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7fb37bfff640 1 -- 172.21.15.103:0/2708723377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb37c06c870 msgr2=0x7fb37c1402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7fb37bfff640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb37c06c870 0x7fb37c1402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.776+0000 7fb37bfff640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c142800 con 0x7fb37c148d70 2024-04-25T10:33:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7fb37bfff640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c148d70 0x7fb37c09d080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb374001490 tx=0x7fb37400cae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3740039a0 con 0x7fb37c148d70 2024-04-25T10:33:47.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374003b40 con 0x7fb37c148d70 2024-04-25T10:33:47.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3740050d0 con 0x7fb37c148d70 2024-04-25T10:33:47.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37c141650 con 0x7fb37c148d70 2024-04-25T10:33:47.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.777+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37c1de4b0 con 0x7fb37c148d70 2024-04-25T10:33:47.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435ad9d640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f435c071720 0x7f435c13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7feb55d9b640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580b3e10 0x7feb581db790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00fad0 tx=0x7feb4c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec13ce80 con 0x7f77ec0afb70 2024-04-25T10:33:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f795ca42640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f793c001030 con 0x7f7940005350 2024-04-25T10:33:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435ad9d640 1 -- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c146260 msgr2=0x7f435c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435ad9d640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f435c146260 0x7f435c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c045070 con 0x7feb580b3e10 2024-04-25T10:33:47.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435ad9d640 1 -- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435c145e50 msgr2=0x7f435c1de4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435ad9d640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f435c145e50 0x7f435c1de4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f435ad9d640 1 -- 172.21.15.103:0/1860659141 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c1de9f0 con 0x7f435c071720 2024-04-25T10:33:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5814b520 con 0x7feb580b3e10 2024-04-25T10:33:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec1dea70 con 0x7f77ec0afb70 2024-04-25T10:33:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb581daf90 con 0x7feb580b3e10 2024-04-25T10:33:47.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c035950 con 0x7feb580b3e10 2024-04-25T10:33:47.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c015070 con 0x7f748c072ed0 2024-04-25T10:33:47.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.778+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747c007a30 con 0x7f748c072ed0 2024-04-25T10:33:47.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c007de0 con 0x7f748c072ed0 2024-04-25T10:33:47.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c0b36a0 con 0x7f748c072ed0 2024-04-25T10:33:47.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7f210bfff640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040cc9a0 0x7f21040b3890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f210000e850 tx=0x7f210000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb35c001030 con 0x7fb37c148d70 2024-04-25T10:33:47.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c0b41e0 con 0x7f748c072ed0 2024-04-25T10:33:47.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7948003990 con 0x7f7940005350 2024-04-25T10:33:47.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7f435ad9d640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f435c071720 0x7f435c13baa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f434c031000 tx=0x7f434c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.779+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100017070 con 0x7f21040cc9a0 2024-04-25T10:33:47.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210000ee40 con 0x7f21040cc9a0 2024-04-25T10:33:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c042020 con 0x7f435c071720 2024-04-25T10:33:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434c03d6b0 con 0x7f435c071720 2024-04-25T10:33:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c037040 con 0x7f435c071720 2024-04-25T10:33:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f43610e2640 1 -- 172.21.15.103:0/1860659141 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c0b2ae0 con 0x7f435c071720 2024-04-25T10:33:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c03a040 con 0x7feb580b3e10 2024-04-25T10:33:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feae0044070 con 0x7feae40cb530 2024-04-25T10:33:47.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fead37fe640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fead8074580 0x7fead8076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f7946ffd640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f79380745b0 0x7f7938076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7948094cd0 con 0x7f7940005350 2024-04-25T10:33:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f7946ffd640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f793807c880 0x7f793807ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f793807f3a0 con 0x7f793807c880 2024-04-25T10:33:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f7948097330 con 0x7f7940005350 2024-04-25T10:33:47.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7f43610e2640 1 -- 172.21.15.103:0/1860659141 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c1470b0 con 0x7f435c071720 2024-04-25T10:33:47.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.780+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb374005270 con 0x7fb37c148d70 2024-04-25T10:33:47.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fb363fff640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb3680745b0 0x7fb368076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb3740a5ca0 con 0x7fb37c148d70 2024-04-25T10:33:47.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fb363fff640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7fb36807c880 0x7fb36807ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb36807f3a0 con 0x7fb36807c880 2024-04-25T10:33:47.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb3740a8300 con 0x7fb37c148d70 2024-04-25T10:33:47.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f748c076b90 con 0x7f748c072ed0 2024-04-25T10:33:47.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feae00b6210 con 0x7feae40cb530 2024-04-25T10:33:47.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fead37fe640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7fead807c850 0x7fead807eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feae004cec0 con 0x7fead807c850 2024-04-25T10:33:47.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feae00b6600 con 0x7feae40cb530 2024-04-25T10:33:47.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb3c001030 con 0x7feb580b3e10 2024-04-25T10:33:47.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7fb37a7fc640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7fb36807c880 0x7fb36807ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7feaeaffd640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fead8074580 0x7fead8076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7feaea7fc640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7fead807c850 0x7fead807eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.782+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7feb4c048070 con 0x7feb580b3e10 2024-04-25T10:33:47.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.782+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f77ec13e480 con 0x7f77ec0afb70 2024-04-25T10:33:47.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100017070 con 0x7f21040cc9a0 2024-04-25T10:33:47.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7f2110934640 1 -- 172.21.15.103:0/3825561244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21040b4910 con 0x7f21040cc9a0 2024-04-25T10:33:47.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.781+0000 7f2110934640 1 -- 172.21.15.103:0/3825561244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210403d920 con 0x7f21040cc9a0 2024-04-25T10:33:47.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.782+0000 7f7955d9b640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f79380745b0 0x7f7938076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.782+0000 7fb37affd640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb3680745b0 0x7fb368076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.782+0000 7feb46ffd640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7feb38074580 0x7feb38076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.782+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feb4c0b9df0 con 0x7feb580b3e10 2024-04-25T10:33:47.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7feb5659c640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7feb38074580 0x7feb38076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7feb46ffd640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7feb3807c770 0x7feb3807ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 --> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb4c033710 con 0x7feb3807c770 2024-04-25T10:33:47.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7feb56d9d640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7feb3807c770 0x7feb3807ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7f43610e2640 1 -- 172.21.15.103:0/1860659141 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f435c06a130 con 0x7f435c071720 2024-04-25T10:33:47.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2104154890 con 0x7f21040cc9a0 2024-04-25T10:33:47.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f434c045020 con 0x7f435c071720 2024-04-25T10:33:47.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7feb4c0805f0 con 0x7feb580b3e10 2024-04-25T10:33:47.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f747c018070 con 0x7f748c072ed0 2024-04-25T10:33:47.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7f7956d9d640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f793807c880 0x7f793807ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7f7955d9b640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f79380745b0 0x7f7938076ac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f79581e1040 tx=0x7f7950009120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f7956d9d640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f793807c880 0x7f793807ecd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f74897fa640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7478074580 0x7f7478076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7fb37affd640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb3680745b0 0x7fb368076ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb36c006f40 tx=0x7fb36c012040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f748bfff640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7478074580 0x7f7478076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f747c03ae00 con 0x7f748c072ed0 2024-04-25T10:33:47.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f77e8011070 con 0x7f77ec0afb70 2024-04-25T10:33:47.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f43437fe640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4348074500 0x7f4348076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7feaea7fc640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7fead807c850 0x7fead807eca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.783+0000 7feaeaffd640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fead8074580 0x7fead8076a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feaec066310 tx=0x7feaec06a590 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f434c0b4de0 con 0x7f435c071720 2024-04-25T10:33:47.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f74897fa640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f747807c850 0x7f747807eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 --> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f747c00fe50 con 0x7f747807c850 2024-04-25T10:33:47.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f747c095780 con 0x7f748c072ed0 2024-04-25T10:33:47.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f77e1ffb640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f77d00745b0 0x7f77d0076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f77e8094e30 con 0x7f77ec0afb70 2024-04-25T10:33:47.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f43437fe640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f434807c7d0 0x7f434807ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 --> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f434c030e50 con 0x7f434807c7d0 2024-04-25T10:33:47.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f434c0ba060 con 0x7f435c071720 2024-04-25T10:33:47.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f210001a070 con 0x7f21040cc9a0 2024-04-25T10:33:47.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7feb56d9d640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7feb3807c770 0x7feb3807ebc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7feb5659c640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7feb38074580 0x7feb38076a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb580b3550 tx=0x7feb50009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7f435a59c640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4348074500 0x7f4348076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f77e1ffb640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f77d007c880 0x7f77d007ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.784+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 <== osd.0 v2:172.21.15.103:6808/1654732884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feae004cec0 con 0x7fead807c850 2024-04-25T10:33:47.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f77f1ed2640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f77d007c880 0x7f77d007ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f435b59e640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f434807c7d0 0x7f434807ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77e8018e50 con 0x7f77d007c880 2024-04-25T10:33:47.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7fb37a7fc640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7fb36807c880 0x7fb36807ecd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f7491590640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f747807c850 0x7f747807eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f20f7fff640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f20f00748b0 0x7f20f0076dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f210000f040 con 0x7f21040cc9a0 2024-04-25T10:33:47.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f77e8097490 con 0x7f77ec0afb70 2024-04-25T10:33:47.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f7491590640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f747807c850 0x7f747807eca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f435a59c640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4348074500 0x7f4348076a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4350000f60 tx=0x7f4350009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f77f1ed2640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f77d007c880 0x7f77d007ecd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f20f7fff640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7f20f007cb00 0x7f20f007ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:47.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20f007f620 con 0x7f20f007cb00 2024-04-25T10:33:47.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f210009b050 con 0x7f21040cc9a0 2024-04-25T10:33:47.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.786+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 <== osd.1 v2:172.21.15.103:6816/1963339576 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb4c033710 con 0x7feb3807c770 2024-04-25T10:33:47.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 <== osd.3 v2:172.21.15.103:6824/2287324132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f793807f3a0 con 0x7f793807c880 2024-04-25T10:33:47.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f77f0ed0640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f77d00745b0 0x7f77d0076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.785+0000 7f435b59e640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f434807c7d0 0x7f434807ec20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.786+0000 7f210affd640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7f20f007cb00 0x7f20f007ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.786+0000 7f210b7fe640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f20f00748b0 0x7f20f0076dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:47.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.786+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 <== osd.5 v2:172.21.15.132:6824/2888495984 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb36807f3a0 con 0x7fb36807c880 2024-04-25T10:33:47.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.786+0000 7f210affd640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7f20f007cb00 0x7f20f007ef50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.786+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 <== osd.2 v2:172.21.15.103:6800/1181469683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77e8018e50 con 0x7f77d007c880 2024-04-25T10:33:47.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.786+0000 7f77f0ed0640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f77d00745b0 0x7f77d0076ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0b25c0 tx=0x7f77dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.786+0000 7f210b7fe640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f20f00748b0 0x7f20f0076dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f210c06b3d0 tx=0x7f210c06a590 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.787+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 <== osd.4 v2:172.21.15.132:6808/1740285832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f434c030e50 con 0x7f434807c7d0 2024-04-25T10:33:47.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.787+0000 7f748bfff640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7478074580 0x7f7478076a90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7484034000 tx=0x7f7484033040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:47.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.787+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 <== osd.6 v2:172.21.15.132:6800/3517858433 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f747c00fe50 con 0x7f747807c850 2024-04-25T10:33:47.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.788+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 <== osd.7 v2:172.21.15.132:6816/2222857157 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20f007f620 con 0x7f20f007cb00 2024-04-25T10:33:47.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.816+0000 7fead17fa640 1 -- 172.21.15.103:0/1410220969 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feac4002dd0 con 0x7fead807c850 2024-04-25T10:33:47.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.816+0000 7fead37fe640 1 -- 172.21.15.103:0/1410220969 <== osd.0 v2:172.21.15.103:6808/1654732884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feac4002dd0 con 0x7fead807c850 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.817+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7fead807c850 msgr2=0x7fead807eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.817+0000 7feaebfff640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7fead807c850 0x7fead807eca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.817+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fead8074580 msgr2=0x7fead8076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.817+0000 7feaebfff640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fead8074580 0x7fead8076a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feaec066310 tx=0x7feaec06a590 comp rx=0 tx=0).stop 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.817+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae40cb530 msgr2=0x7feae40bd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.817+0000 7feaebfff640 1 --2- 172.21.15.103:0/1410220969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feae40cb530 0x7feae40bd180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feae0009870 tx=0x7feae00046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.817+0000 7feaeb7fe640 1 -- 172.21.15.103:0/1410220969 reap_dead start 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.818+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 shutdown_connections 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.818+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 >> 172.21.15.103:0/1410220969 conn(0x7feae403b6c0 msgr2=0x7feae40c06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.818+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 shutdown_connections 2024-04-25T10:33:47.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.818+0000 7feaebfff640 1 -- 172.21.15.103:0/1410220969 wait complete. 2024-04-25T10:33:47.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.818+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 --> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb3c002dd0 con 0x7feb3807c770 2024-04-25T10:33:47.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.819+0000 7feb46ffd640 1 -- 172.21.15.103:0/3523732724 <== osd.1 v2:172.21.15.103:6816/1963339576 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb3c002dd0 con 0x7feb3807c770 2024-04-25T10:33:47.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.818+0000 7f795ca42640 1 -- 172.21.15.103:0/1041115896 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f793c002dd0 con 0x7f793807c880 2024-04-25T10:33:47.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.819+0000 7f7946ffd640 1 -- 172.21.15.103:0/1041115896 <== osd.3 v2:172.21.15.103:6824/2287324132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f793c002dd0 con 0x7f793807c880 2024-04-25T10:33:47.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.819+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb35c002dd0 con 0x7fb36807c880 2024-04-25T10:33:47.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.819+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2104000f60 con 0x7f20f007cb00 2024-04-25T10:33:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.819+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 --> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f748c072800 con 0x7f747807c850 2024-04-25T10:33:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 -- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f793807c880 msgr2=0x7f793807ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f793807c880 0x7f793807ecd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7feb3807c770 msgr2=0x7feb3807ebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb5759e640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7feb3807c770 0x7feb3807ebc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 --> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f77ec06a130 con 0x7f77d007c880 2024-04-25T10:33:47.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 -- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f79380745b0 msgr2=0x7f7938076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f79380745b0 0x7f7938076ac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f79581e1040 tx=0x7f7950009120 comp rx=0 tx=0).stop 2024-04-25T10:33:47.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f20f7fff640 1 -- 172.21.15.103:0/3825561244 <== osd.7 v2:172.21.15.132:6816/2222857157 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2104000f60 con 0x7f20f007cb00 2024-04-25T10:33:47.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 -- 172.21.15.103:0/1041115896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 msgr2=0x7f795814fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 --2- 172.21.15.103:0/1041115896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7940005350 0x7f795814fbd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7948001050 tx=0x7f794800e910 comp rx=0 tx=0).stop 2024-04-25T10:33:47.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7956d9d640 1 -- 172.21.15.103:0/1041115896 reap_dead start 2024-04-25T10:33:47.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7feb38074580 msgr2=0x7feb38076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb5759e640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7feb38074580 0x7feb38076a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb580b3550 tx=0x7feb50009060 comp rx=0 tx=0).stop 2024-04-25T10:33:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580b3e10 msgr2=0x7feb581db790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb5759e640 1 --2- 172.21.15.103:0/3523732724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580b3e10 0x7feb581db790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00fad0 tx=0x7feb4c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb56d9d640 1 -- 172.21.15.103:0/3523732724 reap_dead start 2024-04-25T10:33:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 shutdown_connections 2024-04-25T10:33:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 >> 172.21.15.103:0/3523732724 conn(0x7feb580b7550 msgr2=0x7feb5813f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 -- 172.21.15.103:0/1041115896 shutdown_connections 2024-04-25T10:33:47.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 -- 172.21.15.103:0/1041115896 >> 172.21.15.103:0/1041115896 conn(0x7f795806d150 msgr2=0x7f79580b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f74897fa640 1 -- 172.21.15.103:0/4276662360 <== osd.6 v2:172.21.15.132:6800/3517858433 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f748c072800 con 0x7f747807c850 2024-04-25T10:33:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 -- 172.21.15.103:0/1041115896 shutdown_connections 2024-04-25T10:33:47.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f7944ff9640 1 -- 172.21.15.103:0/1041115896 wait complete. 2024-04-25T10:33:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f43610e2640 1 -- 172.21.15.103:0/1860659141 --> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f435c143ac0 con 0x7f434807c7d0 2024-04-25T10:33:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7fb363fff640 1 -- 172.21.15.103:0/2708723377 <== osd.5 v2:172.21.15.132:6824/2888495984 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb35c002dd0 con 0x7fb36807c880 2024-04-25T10:33:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7f20f007cb00 msgr2=0x7f20f007ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f20f5ffb640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7f20f007cb00 0x7f20f007ef50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.820+0000 7f77e1ffb640 1 -- 172.21.15.103:0/2941530379 <== osd.2 v2:172.21.15.103:6800/1181469683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f77ec06a130 con 0x7f77d007c880 2024-04-25T10:33:47.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 shutdown_connections 2024-04-25T10:33:47.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f747807c850 msgr2=0x7f747807eca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f20f00748b0 msgr2=0x7f20f0076dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f20f5ffb640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f20f00748b0 0x7f20f0076dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f210c06b3d0 tx=0x7f210c06a590 comp rx=0 tx=0).stop 2024-04-25T10:33:47.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491d91640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f747807c850 0x7f747807eca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040cc9a0 msgr2=0x7f21040b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f20f5ffb640 1 --2- 172.21.15.103:0/3825561244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21040cc9a0 0x7f21040b3890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f210000e850 tx=0x7f210000ed10 comp rx=0 tx=0).stop 2024-04-25T10:33:47.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7feb5759e640 1 -- 172.21.15.103:0/3523732724 wait complete. 2024-04-25T10:33:47.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f210bfff640 1 -- 172.21.15.103:0/3825561244 reap_dead start 2024-04-25T10:33:47.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f43437fe640 1 -- 172.21.15.103:0/1860659141 <== osd.4 v2:172.21.15.132:6808/1740285832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f435c143ac0 con 0x7f434807c7d0 2024-04-25T10:33:47.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 shutdown_connections 2024-04-25T10:33:47.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7478074580 msgr2=0x7f7478076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 >> 172.21.15.103:0/3825561244 conn(0x7f210403b270 msgr2=0x7f2104004a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491d91640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7478074580 0x7f7478076a90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7484034000 tx=0x7f7484033040 comp rx=0 tx=0).stop 2024-04-25T10:33:47.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f77d007c880 msgr2=0x7f77d007ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 msgr2=0x7f748c1424c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f77f3935640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f77d007c880 0x7f77d007ecd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491d91640 1 --2- 172.21.15.103:0/4276662360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f748c072ed0 0x7f748c1424c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c820 tx=0x7f747c00cce0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491590640 1 -- 172.21.15.103:0/4276662360 reap_dead start 2024-04-25T10:33:47.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 shutdown_connections 2024-04-25T10:33:47.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f20f5ffb640 1 -- 172.21.15.103:0/3825561244 wait complete. 2024-04-25T10:33:47.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7fb36807c880 msgr2=0x7fb36807ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f77d00745b0 msgr2=0x7f77d0076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f77f3935640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f77d00745b0 0x7f77d0076ac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0b25c0 tx=0x7f77dc008040 comp rx=0 tx=0).stop 2024-04-25T10:33:47.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77ec0afb70 msgr2=0x7f77ec0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f77f3935640 1 --2- 172.21.15.103:0/2941530379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f77ec0afb70 0x7f77ec0b1b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f77e800c3c0 tx=0x7f77e800c880 comp rx=0 tx=0).stop 2024-04-25T10:33:47.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f77f1ed2640 1 -- 172.21.15.103:0/2941530379 reap_dead start 2024-04-25T10:33:47.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 shutdown_connections 2024-04-25T10:33:47.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 >> 172.21.15.103:0/4276662360 conn(0x7f748c0bb060 msgr2=0x7f748c0b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.821+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 shutdown_connections 2024-04-25T10:33:47.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 >> 172.21.15.103:0/2941530379 conn(0x7f77ec0b7c10 msgr2=0x7f77ec148eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 shutdown_connections 2024-04-25T10:33:47.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f7491d91640 1 -- 172.21.15.103:0/4276662360 wait complete. 2024-04-25T10:33:47.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7fb36807c880 0x7fb36807ecd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 shutdown_connections 2024-04-25T10:33:47.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb3680745b0 msgr2=0x7fb368076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb3680745b0 0x7fb368076ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb36c006f40 tx=0x7fb36c012040 comp rx=0 tx=0).stop 2024-04-25T10:33:47.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c148d70 msgr2=0x7fb37c09d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 --2- 172.21.15.103:0/2708723377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb37c148d70 0x7fb37c09d080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb374001490 tx=0x7fb37400cae0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb37bfff640 1 -- 172.21.15.103:0/2708723377 reap_dead start 2024-04-25T10:33:47.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 shutdown_connections 2024-04-25T10:33:47.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 >> 172.21.15.103:0/2708723377 conn(0x7fb37c09ff70 msgr2=0x7fb37c073520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f77f3935640 1 -- 172.21.15.103:0/2941530379 wait complete. 2024-04-25T10:33:47.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f43417fa640 1 -- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f434807c7d0 msgr2=0x7f434807ec20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f43417fa640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f434807c7d0 0x7f434807ec20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 shutdown_connections 2024-04-25T10:33:47.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7fb381938640 1 -- 172.21.15.103:0/2708723377 wait complete. 2024-04-25T10:33:47.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f43417fa640 1 -- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4348074500 msgr2=0x7f4348076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.822+0000 7f43417fa640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4348074500 0x7f4348076a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4350000f60 tx=0x7f4350009040 comp rx=0 tx=0).stop 2024-04-25T10:33:47.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.823+0000 7f43417fa640 1 -- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f435c071720 msgr2=0x7f435c13baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:47.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.823+0000 7f43417fa640 1 --2- 172.21.15.103:0/1860659141 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f435c071720 0x7f435c13baa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f434c031000 tx=0x7f434c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:47.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.823+0000 7f435b59e640 1 -- 172.21.15.103:0/1860659141 reap_dead start 2024-04-25T10:33:47.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.823+0000 7f43417fa640 1 -- 172.21.15.103:0/1860659141 shutdown_connections 2024-04-25T10:33:47.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.823+0000 7f43417fa640 1 -- 172.21.15.103:0/1860659141 >> 172.21.15.103:0/1860659141 conn(0x7f435c0b77a0 msgr2=0x7f435c06c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:47.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.823+0000 7f43417fa640 1 -- 172.21.15.103:0/1860659141 shutdown_connections 2024-04-25T10:33:47.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:47.823+0000 7f43417fa640 1 -- 172.21.15.103:0/1860659141 wait complete. 2024-04-25T10:33:47.911 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:47.911 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T10:33:47.912 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:47.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T10:33:47.913 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:47.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T10:33:47.915 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:47.915 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T10:33:47.915 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:47.916 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:47.916 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T10:33:47.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T10:33:47.918 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:47.918 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T10:33:47.919 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:47.919 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T10:33:48.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.157+0000 7f631e950640 1 Processor -- start 2024-04-25T10:33:48.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.157+0000 7f631e950640 1 -- start start 2024-04-25T10:33:48.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631e950640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6310031fa0 0x7f631001c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631e950640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63100cae60 0x7f63100cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631e950640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f631001dc80 con 0x7f6310039db0 2024-04-25T10:33:48.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631e950640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f631001e2d0 con 0x7f6310031fa0 2024-04-25T10:33:48.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631e950640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f63100323b0 con 0x7f63100cae60 2024-04-25T10:33:48.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631e14f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63100cae60 0x7f63100cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631d94e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6310031fa0 0x7f631001c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631e14f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63100cae60 0x7f63100cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58686/0 (socket says 172.21.15.103:58686) 2024-04-25T10:33:48.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631e14f640 1 -- 172.21.15.103:0/1875221404 learned_addr learned my addr 172.21.15.103:0/1875221404 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7f631d14d640 1 --1- 172.21.15.103:0/1875221404 >> v1:172.21.15.103:6789/0 conn(0x7f6310039db0 0x7f631003a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33064/0 (socket says 172.21.15.103:33064) 2024-04-25T10:33:48.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.160+0000 7f631e14f640 1 -- 172.21.15.103:0/1875221404 >> v2:172.21.15.103:3300/0 conn(0x7f6310031fa0 msgr2=0x7f631001c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.160+0000 7f631e14f640 1 --2- 172.21.15.103:0/1875221404 >> v2:172.21.15.103:3300/0 conn(0x7f6310031fa0 0x7f631001c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.160+0000 7f631e14f640 1 -- 172.21.15.103:0/1875221404 >> v1:172.21.15.103:6789/0 conn(0x7f6310039db0 legacy=0x7f631003a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.160+0000 7f631e14f640 1 -- 172.21.15.103:0/1875221404 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631001df60 con 0x7f63100cae60 2024-04-25T10:33:48.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.159+0000 7ff397134640 1 Processor -- start 2024-04-25T10:33:48.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.160+0000 7ff397134640 1 -- start start 2024-04-25T10:33:48.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.160+0000 7f631e14f640 1 --2- 172.21.15.103:0/1875221404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63100cae60 0x7f63100cb270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6318069ea0 tx=0x7f63180a70a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b26bac18ac55ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.161+0000 7f631c94c640 1 -- 172.21.15.103:0/1875221404 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180b4070 con 0x7f63100cae60 2024-04-25T10:33:48.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.161+0000 7f08fe4fc640 1 Processor -- start 2024-04-25T10:33:48.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.161+0000 7fed5f16c640 1 Processor -- start 2024-04-25T10:33:48.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.161+0000 7fed5f16c640 1 -- start start 2024-04-25T10:33:48.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.161+0000 7f213aaa7640 1 Processor -- start 2024-04-25T10:33:48.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.161+0000 7f08fe4fc640 1 -- start start 2024-04-25T10:33:48.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7f631c94c640 1 -- 172.21.15.103:0/1875221404 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63180a7cc0 con 0x7f63100cae60 2024-04-25T10:33:48.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7f7b15a67640 1 Processor -- start 2024-04-25T10:33:48.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7ff397134640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff3880349f0 0x7ff388036100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7ff397134640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff388033bd0 0x7ff3880374a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7f631c94c640 1 -- 172.21.15.103:0/1875221404 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180af640 con 0x7f63100cae60 2024-04-25T10:33:48.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7ff395931640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff388033bd0 0x7ff3880374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7ff395931640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff388033bd0 0x7ff3880374a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48768/0 (socket says 172.21.15.103:48768) 2024-04-25T10:33:48.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7ff395931640 1 -- 172.21.15.103:0/210924954 learned_addr learned my addr 172.21.15.103:0/210924954 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7f7b15a67640 1 -- start start 2024-04-25T10:33:48.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7ff396132640 1 --2- 172.21.15.103:0/210924954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff3880349f0 0x7ff388036100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7ff397134640 1 -- 172.21.15.103:0/210924954 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff388036820 con 0x7ff3880d1050 2024-04-25T10:33:48.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.161+0000 7f213aaa7640 1 -- start start 2024-04-25T10:33:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f08fe4fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f08f814ad30 0x7f08f814b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f631e950640 1 -- 172.21.15.103:0/1875221404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63100cae60 msgr2=0x7f63100cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f631e950640 1 --2- 172.21.15.103:0/1875221404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63100cae60 0x7f63100cb270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6318069ea0 tx=0x7f63180a70a0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f631e950640 1 -- 172.21.15.103:0/1875221404 shutdown_connections 2024-04-25T10:33:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f631e950640 1 --2- 172.21.15.103:0/1875221404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63100cae60 0x7f63100cb270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f631e950640 1 --2- 172.21.15.103:0/1875221404 >> v2:172.21.15.103:3300/0 conn(0x7f6310031fa0 0x7f631001c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f631e950640 1 -- 172.21.15.103:0/1875221404 >> 172.21.15.103:0/1875221404 conn(0x7f631003b7b0 msgr2=0x7f631003bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f213aaa7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2134145880 0x7f213406dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f213aaa7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f21340b3fc0 0x7f21340b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f213aaa7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21341490c0 con 0x7f21341498c0 2024-04-25T10:33:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f213aaa7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2134148e70 con 0x7f2134145880 2024-04-25T10:33:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f213aaa7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f21340b53e0 con 0x7f21340b3fc0 2024-04-25T10:33:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f08fe4fc640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f81473f0 con 0x7f08f806c630 2024-04-25T10:33:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f08fe4fc640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f81476d0 con 0x7f08f8147ed0 2024-04-25T10:33:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f08fe4fc640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f08f81479b0 con 0x7f08f814ad30 2024-04-25T10:33:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f08fdcfb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f08f814ad30 0x7f08f814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f2138843640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2134145880 0x7f213406dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f08fdcfb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f08f814ad30 0x7f08f814b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48776/0 (socket says 172.21.15.103:48776) 2024-04-25T10:33:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7ff395130640 1 -- 172.21.15.103:0/210924954 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776274391 0 0) 0x7ff388036820 con 0x7ff3880d1050 2024-04-25T10:33:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f2138843640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2134145880 0x7f213406dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48798/0 (socket says 172.21.15.103:48798) 2024-04-25T10:33:48.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f2138843640 1 -- 172.21.15.103:0/274204787 learned_addr learned my addr 172.21.15.103:0/274204787 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f08fdcfb640 1 -- 172.21.15.103:0/3379251733 learned_addr learned my addr 172.21.15.103:0/3379251733 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7fed5f16c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed50037930 0x7fed5003a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7fed5f16c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fed500ce7f0 0x7fed500c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7fed5f16c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed50035120 con 0x7fed500c48b0 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7fed5f16c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fed500c5200 con 0x7fed500ce7f0 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7fed5f16c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fed50037d40 con 0x7fed50037930 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7fed5d969640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fed500c48b0 0x7fed500ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.103:47946/0 (socket says 172.21.15.103:47946) 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7fed5d969640 1 -- 172.21.15.103:0/1072611417 learned_addr learned my addr 172.21.15.103:0/1072611417 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7fed5e96b640 1 --2- 172.21.15.103:0/1072611417 >> v2:172.21.15.103:3300/0 conn(0x7fed500ce7f0 0x7fed500c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7ff397134640 1 -- 172.21.15.103:0/210924954 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff388036e70 con 0x7ff388033bd0 2024-04-25T10:33:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7ff397134640 1 -- 172.21.15.103:0/210924954 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff3880cb7f0 con 0x7ff3880349f0 2024-04-25T10:33:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7ff395130640 1 -- 172.21.15.103:0/210924954 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff37c003520 con 0x7ff3880d1050 2024-04-25T10:33:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f7b15a67640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b1014e180 0x7f7b1006f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f7b15a67640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1009da00 con 0x7f7b10150fe0 2024-04-25T10:33:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f7b15a67640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b101515e0 con 0x7f7b1014a670 2024-04-25T10:33:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f7b15a67640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7b10151c30 con 0x7f7b1014e180 2024-04-25T10:33:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f7b0ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7b1014a670 0x7f7b1014aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.103:47980/0 (socket says 172.21.15.103:47980) 2024-04-25T10:33:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f631e950640 1 -- 172.21.15.103:0/1875221404 shutdown_connections 2024-04-25T10:33:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f08fdcfb640 1 -- 172.21.15.103:0/3379251733 >> v1:172.21.15.132:6789/0 conn(0x7f08f8147ed0 legacy=0x7f08f80b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f08fdcfb640 1 -- 172.21.15.103:0/3379251733 >> v1:172.21.15.103:6789/0 conn(0x7f08f806c630 legacy=0x7f08f8073680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f08fdcfb640 1 -- 172.21.15.103:0/3379251733 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f806ca40 con 0x7f08f814ad30 2024-04-25T10:33:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f7b0ffff640 1 -- 172.21.15.103:0/3368876630 learned_addr learned my addr 172.21.15.103:0/3368876630 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7fed5e96b640 1 -- 172.21.15.103:0/1072611417 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed50037930 msgr2=0x7fed5003a1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:33:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7fed5e96b640 1 --2- 172.21.15.103:0/1072611417 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed50037930 0x7fed5003a1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7fed5e96b640 1 -- 172.21.15.103:0/1072611417 >> v1:172.21.15.132:6789/0 conn(0x7fed500c48b0 legacy=0x7fed500ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7fed5e96b640 1 -- 172.21.15.103:0/1072611417 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5002b140 con 0x7fed500ce7f0 2024-04-25T10:33:48.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7ff395931640 1 -- 172.21.15.103:0/210924954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff3880349f0 msgr2=0x7ff388036100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7ff395931640 1 --2- 172.21.15.103:0/210924954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff3880349f0 0x7ff388036100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7ff395931640 1 -- 172.21.15.103:0/210924954 >> v1:172.21.15.103:6789/0 conn(0x7ff3880d1050 legacy=0x7ff3880d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7ff395931640 1 -- 172.21.15.103:0/210924954 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff388036b00 con 0x7ff388033bd0 2024-04-25T10:33:48.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7f799a1f3640 1 Processor -- start 2024-04-25T10:33:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.163+0000 7f2139044640 1 --2- 172.21.15.103:0/274204787 >> v2:172.21.15.132:3300/0 conn(0x7f21340b3fc0 0x7f21340b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f2138843640 1 -- 172.21.15.103:0/274204787 >> v2:172.21.15.132:3300/0 conn(0x7f21340b3fc0 msgr2=0x7f21340b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f2138843640 1 --2- 172.21.15.103:0/274204787 >> v2:172.21.15.132:3300/0 conn(0x7f21340b3fc0 0x7f21340b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f2138843640 1 -- 172.21.15.103:0/274204787 >> v1:172.21.15.132:6789/0 conn(0x7f21341498c0 legacy=0x7f2134073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f2138843640 1 -- 172.21.15.103:0/274204787 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21341493a0 con 0x7f2134145880 2024-04-25T10:33:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.162+0000 7f799a1f3640 1 -- start start 2024-04-25T10:33:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f7b0effd640 1 --2- 172.21.15.103:0/3368876630 >> v2:172.21.15.103:3300/0 conn(0x7f7b1014e180 0x7f7b1006f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f799a1f3640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79940b3fc0 0x7f79940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f799a1f3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f799406c7a0 0x7f7994141410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f799a1f3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7994141950 0x7f79940b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f799a1f3640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f79940b43d0 con 0x7f79940b3fc0 2024-04-25T10:33:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f799a1f3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f799406f6e0 con 0x7f7994141950 2024-04-25T10:33:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f799a1f3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f79940b4cc0 con 0x7f799406c7a0 2024-04-25T10:33:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f7b0e7fc640 1 -- 172.21.15.103:0/3368876630 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547736491 0 0) 0x7f7b101515e0 con 0x7f7b1014a670 2024-04-25T10:33:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7ff901f6b640 1 Processor -- start 2024-04-25T10:33:48.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f631e950640 1 -- 172.21.15.103:0/1875221404 wait complete. 2024-04-25T10:33:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.164+0000 7f7b0e7fc640 1 -- 172.21.15.103:0/3368876630 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7af8003520 con 0x7f7b1014a670 2024-04-25T10:33:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7993fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7994141950 0x7f79940b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f79937fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79940b3fc0 0x7f79940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7993fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7994141950 0x7f79940b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58702/0 (socket says 172.21.15.103:58702) 2024-04-25T10:33:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7993fff640 1 -- 172.21.15.103:0/2822816696 learned_addr learned my addr 172.21.15.103:0/2822816696 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7992ffd640 1 --2- 172.21.15.103:0/2822816696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f799406c7a0 0x7f7994141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7b0e7fc640 1 -- 172.21.15.103:0/3368876630 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3288812595 0 0) 0x7f7af8003520 con 0x7f7b1014a670 2024-04-25T10:33:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7ff901f6b640 1 -- start start 2024-04-25T10:33:48.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7fed5e96b640 1 --2- 172.21.15.103:0/1072611417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed500ce7f0 0x7fed500c4cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed58000b60 tx=0x7fed580ab340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1053bb7b9124b699 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f08fdcfb640 1 --2- 172.21.15.103:0/3379251733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f814ad30 0x7f08f814b140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009870 tx=0x7f08e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93990c31fb7ec7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f2138843640 1 --2- 172.21.15.103:0/274204787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2134145880 0x7f213406dbb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f213406e120 tx=0x7f212402e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a86a8bf937cfcf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7b0effd640 1 -- 172.21.15.103:0/3368876630 >> v1:172.21.15.132:6789/0 conn(0x7f7b1014a670 legacy=0x7f7b1014aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7b0effd640 1 -- 172.21.15.103:0/3368876630 >> v1:172.21.15.103:6789/0 conn(0x7f7b10150fe0 legacy=0x7f7b1014da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7b0effd640 1 -- 172.21.15.103:0/3368876630 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b101518c0 con 0x7f7b1014e180 2024-04-25T10:33:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7992ffd640 1 -- 172.21.15.103:0/2822816696 >> v2:172.21.15.132:3300/0 conn(0x7f7994141950 msgr2=0x7f79940b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7992ffd640 1 --2- 172.21.15.103:0/2822816696 >> v2:172.21.15.132:3300/0 conn(0x7f7994141950 0x7f79940b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7992ffd640 1 -- 172.21.15.103:0/2822816696 >> v2:172.21.15.103:3300/0 conn(0x7f79940b3fc0 msgr2=0x7f79940b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7992ffd640 1 --2- 172.21.15.103:0/2822816696 >> v2:172.21.15.103:3300/0 conn(0x7f79940b3fc0 0x7f79940b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7f7992ffd640 1 -- 172.21.15.103:0/2822816696 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79940b4fa0 con 0x7f799406c7a0 2024-04-25T10:33:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.165+0000 7ff395931640 1 --2- 172.21.15.103:0/210924954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388033bd0 0x7ff3880374a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009870 tx=0x7ff38c02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c088a72d9591f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7f08f7fff640 1 -- 172.21.15.103:0/3379251733 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0037070 con 0x7f08f814ad30 2024-04-25T10:33:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7ff395130640 1 -- 172.21.15.103:0/210924954 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c037070 con 0x7ff388033bd0 2024-04-25T10:33:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7ff395130640 1 -- 172.21.15.103:0/210924954 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c032440 con 0x7ff388033bd0 2024-04-25T10:33:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7ff395130640 1 -- 172.21.15.103:0/210924954 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c032810 con 0x7ff388033bd0 2024-04-25T10:33:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7f08f7fff640 1 -- 172.21.15.103:0/3379251733 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e0032440 con 0x7f08f814ad30 2024-04-25T10:33:48.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7fed5d168640 1 -- 172.21.15.103:0/1072611417 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed580b8070 con 0x7fed500ce7f0 2024-04-25T10:33:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7fed5d168640 1 -- 172.21.15.103:0/1072611417 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed580b3440 con 0x7fed500ce7f0 2024-04-25T10:33:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7fed5d168640 1 -- 172.21.15.103:0/1072611417 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed580b8070 con 0x7fed500ce7f0 2024-04-25T10:33:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7f08f7fff640 1 -- 172.21.15.103:0/3379251733 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0032810 con 0x7f08f814ad30 2024-04-25T10:33:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7f21337fe640 1 -- 172.21.15.103:0/274204787 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212403a070 con 0x7f2134145880 2024-04-25T10:33:48.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7f21337fe640 1 -- 172.21.15.103:0/274204787 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2124033710 con 0x7f2134145880 2024-04-25T10:33:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7f7b0effd640 1 --2- 172.21.15.103:0/3368876630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014e180 0x7f7b1006f310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7b000097a0 tx=0x7f7b0002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd5c03bc12c1bda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7ff901f6b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc071720 0x7ff8fc13f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7ff901f6b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8fc145650 con 0x7ff8fc145e50 2024-04-25T10:33:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7ff901f6b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8fc145930 con 0x7ff8fc146260 2024-04-25T10:33:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.166+0000 7ff901f6b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc0b0900 con 0x7ff8fc071720 2024-04-25T10:33:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff8faffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff8fc145e50 0x7ff8fc0afaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33088/0 (socket says 172.21.15.103:33088) 2024-04-25T10:33:48.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff8faffd640 1 -- 172.21.15.103:0/1255890829 learned_addr learned my addr 172.21.15.103:0/1255890829 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f7992ffd640 1 --2- 172.21.15.103:0/2822816696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f799406c7a0 0x7f7994141410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7994072a80 tx=0x7f798c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f419d5efc7f6bc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f631e950640 1 Processor -- start 2024-04-25T10:33:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f631e950640 1 -- start start 2024-04-25T10:33:48.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff8fb7fe640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc071720 0x7ff8fc13f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f79927fc640 1 -- 172.21.15.103:0/2822816696 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c031600 con 0x7f799406c7a0 2024-04-25T10:33:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f7b0e7fc640 1 -- 172.21.15.103:0/3368876630 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00037070 con 0x7f7b1014e180 2024-04-25T10:33:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f08fe4fc640 1 -- 172.21.15.103:0/3379251733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f814ad30 msgr2=0x7f08f814b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f08fe4fc640 1 --2- 172.21.15.103:0/3379251733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f814ad30 0x7f08f814b140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009870 tx=0x7f08e002a270 comp rx=0 tx=0).stop 2024-04-25T10:33:48.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f79927fc640 1 -- 172.21.15.103:0/2822816696 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c0317a0 con 0x7f799406c7a0 2024-04-25T10:33:48.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f79927fc640 1 -- 172.21.15.103:0/2822816696 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c031b70 con 0x7f799406c7a0 2024-04-25T10:33:48.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f08fe4fc640 1 -- 172.21.15.103:0/3379251733 shutdown_connections 2024-04-25T10:33:48.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f08fe4fc640 1 --2- 172.21.15.103:0/3379251733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f814ad30 0x7f08f814b140 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f08fe4fc640 1 -- 172.21.15.103:0/3379251733 >> 172.21.15.103:0/3379251733 conn(0x7f08f80b8110 msgr2=0x7f08f80b8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f7b0e7fc640 1 -- 172.21.15.103:0/3368876630 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0002abf0 con 0x7f7b1014e180 2024-04-25T10:33:48.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7f7b0e7fc640 1 -- 172.21.15.103:0/3368876630 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04001670 con 0x7f7b1014e180 2024-04-25T10:33:48.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836586249 0 0) 0x7ff8fc145930 con 0x7ff8fc146260 2024-04-25T10:33:48.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7fed5f16c640 1 -- 172.21.15.103:0/1072611417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed500ce7f0 msgr2=0x7fed500c4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1072611417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed500ce7f0 0x7fed500c4cc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed58000b60 tx=0x7fed580ab340 comp rx=0 tx=0).stop 2024-04-25T10:33:48.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff397134640 1 -- 172.21.15.103:0/210924954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388033bd0 msgr2=0x7ff3880374a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff397134640 1 --2- 172.21.15.103:0/210924954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388033bd0 0x7ff3880374a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009870 tx=0x7ff38c02a1f0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e4003520 con 0x7ff8fc146260 2024-04-25T10:33:48.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544857635 0 0) 0x7ff8fc145650 con 0x7ff8fc145e50 2024-04-25T10:33:48.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7fed5f16c640 1 -- 172.21.15.103:0/1072611417 shutdown_connections 2024-04-25T10:33:48.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1072611417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed500ce7f0 0x7fed500c4cc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8fc145930 con 0x7ff8fc145e50 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.167+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 287622655 0 0) 0x7ff8e4003520 con 0x7ff8fc146260 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc071720 msgr2=0x7ff8fc13f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc071720 0x7ff8fc13f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 >> v1:172.21.15.103:6789/0 conn(0x7ff8fc145e50 legacy=0x7ff8fc0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc0b4f90 con 0x7ff8fc146260 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7ff8f40019f0 con 0x7ff8fc146260 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 >> v1:172.21.15.132:6789/0 conn(0x7ff8fc146260 legacy=0x7ff8fc14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4003b70 0x7ff8e4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8e4004800 0x7ff8e4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8e4005210 0x7ff8e400fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0b0900 con 0x7ff8e4003b70 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e4010550 con 0x7ff8e4004800 2024-04-25T10:33:48.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff8e4010750 con 0x7ff8e4005210 2024-04-25T10:33:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1072611417 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed50037930 0x7fed5003a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7fed5f16c640 1 -- 172.21.15.103:0/1072611417 >> 172.21.15.103:0/1072611417 conn(0x7fed5003b6c0 msgr2=0x7fed500064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f213aaa7640 1 -- 172.21.15.103:0/274204787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2134145880 msgr2=0x7f213406dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f213aaa7640 1 --2- 172.21.15.103:0/274204787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2134145880 0x7f213406dbb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f213406e120 tx=0x7f212402e660 comp rx=0 tx=0).stop 2024-04-25T10:33:48.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f21337fe640 1 -- 172.21.15.103:0/274204787 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2124033ae0 con 0x7f2134145880 2024-04-25T10:33:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f08fe4fc640 1 -- 172.21.15.103:0/3379251733 shutdown_connections 2024-04-25T10:33:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7fed5f16c640 1 -- 172.21.15.103:0/1072611417 shutdown_connections 2024-04-25T10:33:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff397134640 1 -- 172.21.15.103:0/210924954 shutdown_connections 2024-04-25T10:33:48.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff397134640 1 --2- 172.21.15.103:0/210924954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff388033bd0 0x7ff3880374a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 -- 172.21.15.103:0/2822816696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f799406c7a0 msgr2=0x7f7994141410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 --2- 172.21.15.103:0/2822816696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f799406c7a0 0x7f7994141410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7994072a80 tx=0x7f798c02a5d0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fb7fe640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc071720 0x7ff8fc13f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8faffd640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8e4004800 0x7ff8e4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fbfff640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8e4005210 0x7ff8e400fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8fb7fe640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4003b70 0x7ff8e4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8faffd640 1 -- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8e4005210 msgr2=0x7ff8e400fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 -- 172.21.15.103:0/2822816696 shutdown_connections 2024-04-25T10:33:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 --2- 172.21.15.103:0/2822816696 >> v2:172.21.15.132:3300/0 conn(0x7f7994141950 0x7f79940b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 --2- 172.21.15.103:0/2822816696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f799406c7a0 0x7f7994141410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 --2- 172.21.15.103:0/2822816696 >> v2:172.21.15.103:3300/0 conn(0x7f79940b3fc0 0x7f79940b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 -- 172.21.15.103:0/2822816696 >> 172.21.15.103:0/2822816696 conn(0x7f79940bc9a0 msgr2=0x7f79940bcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 -- 172.21.15.103:0/2822816696 shutdown_connections 2024-04-25T10:33:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff397134640 1 --2- 172.21.15.103:0/210924954 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff3880349f0 0x7ff388036100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff397134640 1 -- 172.21.15.103:0/210924954 >> 172.21.15.103:0/210924954 conn(0x7ff38803b270 msgr2=0x7ff388006090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e950640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6310031fa0 0x7f6310032b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e950640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6310039db0 0x7f63100350a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e950640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63100cae60 0x7f63100330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e950640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63100cb930 con 0x7f63100cae60 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e950640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f63100cb7b0 con 0x7f6310031fa0 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e950640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f631001c8a0 con 0x7f6310039db0 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e14f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63100cae60 0x7f63100330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631d94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6310031fa0 0x7f6310032b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e14f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63100cae60 0x7f63100330f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48852/0 (socket says 172.21.15.103:48852) 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631e14f640 1 -- 172.21.15.103:0/3484959312 learned_addr learned my addr 172.21.15.103:0/3484959312 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f631d14d640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6310039db0 0x7f63100350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f213aaa7640 1 -- 172.21.15.103:0/274204787 shutdown_connections 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f213aaa7640 1 --2- 172.21.15.103:0/274204787 >> v2:172.21.15.132:3300/0 conn(0x7f21340b3fc0 0x7f21340b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f213aaa7640 1 --2- 172.21.15.103:0/274204787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2134145880 0x7f213406dbb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f213aaa7640 1 -- 172.21.15.103:0/274204787 >> 172.21.15.103:0/274204787 conn(0x7f213406ce50 msgr2=0x7f213406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8faffd640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8e4005210 0x7ff8e400fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8faffd640 1 -- 172.21.15.103:0/1255890829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4003b70 msgr2=0x7ff8e4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8faffd640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4003b70 0x7ff8e4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7ff8faffd640 1 -- 172.21.15.103:0/1255890829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc0b4f90 con 0x7ff8e4004800 2024-04-25T10:33:48.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f08fe4fc640 1 -- 172.21.15.103:0/3379251733 wait complete. 2024-04-25T10:33:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f7b15a67640 1 -- 172.21.15.103:0/3368876630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014e180 msgr2=0x7f7b1006f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f7b15a67640 1 --2- 172.21.15.103:0/3368876630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014e180 0x7f7b1006f310 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7b000097a0 tx=0x7f7b0002a160 comp rx=0 tx=0).stop 2024-04-25T10:33:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f213aaa7640 1 -- 172.21.15.103:0/274204787 shutdown_connections 2024-04-25T10:33:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f631e14f640 1 -- 172.21.15.103:0/3484959312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6310039db0 msgr2=0x7f63100350a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f631e14f640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6310039db0 0x7f63100350a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f631e14f640 1 -- 172.21.15.103:0/3484959312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6310031fa0 msgr2=0x7f6310032b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7ff8fb7fe640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4003b70 0x7ff8e4003fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7f799a1f3640 1 -- 172.21.15.103:0/2822816696 wait complete. 2024-04-25T10:33:48.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7ff397134640 1 -- 172.21.15.103:0/210924954 shutdown_connections 2024-04-25T10:33:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f631e14f640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6310031fa0 0x7f6310032b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f631e14f640 1 -- 172.21.15.103:0/3484959312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63100d1b40 con 0x7f63100cae60 2024-04-25T10:33:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f631d94e640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6310031fa0 0x7f6310032b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f213aaa7640 1 -- 172.21.15.103:0/274204787 wait complete. 2024-04-25T10:33:48.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f631e14f640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63100cae60 0x7f63100330f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6318065b40 tx=0x7f631806a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.168+0000 7fed5f16c640 1 -- 172.21.15.103:0/1072611417 wait complete. 2024-04-25T10:33:48.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f7b15a67640 1 -- 172.21.15.103:0/3368876630 shutdown_connections 2024-04-25T10:33:48.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f7b15a67640 1 --2- 172.21.15.103:0/3368876630 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014e180 0x7f7b1006f310 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f7b15a67640 1 -- 172.21.15.103:0/3368876630 >> 172.21.15.103:0/3368876630 conn(0x7f7b100b8120 msgr2=0x7f7b1006e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f630e7fc640 1 -- 172.21.15.103:0/3484959312 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180b4040 con 0x7f63100cae60 2024-04-25T10:33:48.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7f7b15a67640 1 -- 172.21.15.103:0/3368876630 shutdown_connections 2024-04-25T10:33:48.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7ff8faffd640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8e4004800 0x7ff8e4004c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc070c10 tx=0x7ff8e4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a945078ec0d4d582 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.170+0000 7f631e950640 1 -- 172.21.15.103:0/3484959312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6310167380 con 0x7f63100cae60 2024-04-25T10:33:48.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.169+0000 7ff397134640 1 -- 172.21.15.103:0/210924954 wait complete. 2024-04-25T10:33:48.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.170+0000 7f631e950640 1 -- 172.21.15.103:0/3484959312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6310167620 con 0x7f63100cae60 2024-04-25T10:33:48.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.170+0000 7f7b15a67640 1 -- 172.21.15.103:0/3368876630 wait complete. 2024-04-25T10:33:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.170+0000 7f799a1f3640 1 Processor -- start 2024-04-25T10:33:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.170+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0007c60 con 0x7ff8e4004800 2024-04-25T10:33:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.170+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8f0005ad0 con 0x7ff8e4004800 2024-04-25T10:33:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.170+0000 7ff8fa7fc640 1 -- 172.21.15.103:0/1255890829 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0007c60 con 0x7ff8e4004800 2024-04-25T10:33:48.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.171+0000 7fed5f16c640 1 Processor -- start 2024-04-25T10:33:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.171+0000 7fed5f16c640 1 -- start start 2024-04-25T10:33:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.171+0000 7f213aaa7640 1 Processor -- start 2024-04-25T10:33:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.171+0000 7f213aaa7640 1 -- start start 2024-04-25T10:33:48.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7f08fe4fc640 1 Processor -- start 2024-04-25T10:33:48.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.171+0000 7f799a1f3640 1 -- start start 2024-04-25T10:33:48.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7f630e7fc640 1 -- 172.21.15.103:0/3484959312 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63180a7a60 con 0x7f63100cae60 2024-04-25T10:33:48.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7f630e7fc640 1 -- 172.21.15.103:0/3484959312 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180b8640 con 0x7f63100cae60 2024-04-25T10:33:48.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7f6303fff640 1 -- 172.21.15.103:0/3484959312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63100d1f20 con 0x7f63100cae60 2024-04-25T10:33:48.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7f630e7fc640 1 -- 172.21.15.103:0/3484959312 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f63180bf030 con 0x7f63100cae60 2024-04-25T10:33:48.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7f7b15a67640 1 Processor -- start 2024-04-25T10:33:48.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f7b15a67640 1 -- start start 2024-04-25T10:33:48.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5f16c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50037930 0x7fed500ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7ff397134640 1 Processor -- start 2024-04-25T10:33:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7ff397134640 1 -- start start 2024-04-25T10:33:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f799a1f3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799406c7a0 0x7f799413cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f79937fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799406c7a0 0x7f799413cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f79937fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799406c7a0 0x7f799413cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48854/0 (socket says 172.21.15.103:48854) 2024-04-25T10:33:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f79937fe640 1 -- 172.21.15.103:0/1122158868 learned_addr learned my addr 172.21.15.103:0/1122158868 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f799a1f3640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79940b3fc0 0x7f799412f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f799a1f3640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7994141950 0x7f7994131e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5e16a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50037930 0x7fed500ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5e16a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50037930 0x7fed500ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48868/0 (socket says 172.21.15.103:48868) 2024-04-25T10:33:48.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5e16a640 1 -- 172.21.15.103:0/1763396539 learned_addr learned my addr 172.21.15.103:0/1763396539 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f79940b6960 con 0x7f799406c7a0 2024-04-25T10:33:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f79940b9170 con 0x7f79940b3fc0 2024-04-25T10:33:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f79940b6ae0 con 0x7f7994141950 2024-04-25T10:33:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed500c48b0 0x7fed500c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed500ce7f0 0x7fed5015ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed5003a700 con 0x7fed50037930 2024-04-25T10:33:48.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7f213aaa7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21340b3fc0 0x7f2134141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fed50035480 con 0x7fed500ce7f0 2024-04-25T10:33:48.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fed5015e6a0 con 0x7fed500c48b0 2024-04-25T10:33:48.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7fed5e96b640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed500ce7f0 0x7fed5015ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f213aaa7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2134145880 0x7f21340b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f213aaa7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21341498c0 0x7f21340b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f7992ffd640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79940b3fc0 0x7f799412f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7ff397134640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff388033bd0 0x7ff3880cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.173+0000 7ff397134640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3880349f0 0x7ff38802a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff397134640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3880d1050 0x7ff38802acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff397134640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff388034160 con 0x7ff3880d1050 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff397134640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff388033fe0 con 0x7ff3880349f0 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff397134640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff3880db9d0 con 0x7ff388033bd0 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396933640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3880d1050 0x7ff38802acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396132640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff388033bd0 0x7ff3880cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396933640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3880d1050 0x7ff38802acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48884/0 (socket says 172.21.15.103:48884) 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396933640 1 -- 172.21.15.103:0/151477575 learned_addr learned my addr 172.21.15.103:0/151477575 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.172+0000 7f08fe4fc640 1 -- start start 2024-04-25T10:33:48.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f2139044640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21341498c0 0x7f21340b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f2139044640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21341498c0 0x7f21340b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48894/0 (socket says 172.21.15.103:48894) 2024-04-25T10:33:48.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fe4fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08f806c630 0x7f08f814a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f2139044640 1 -- 172.21.15.103:0/1397000067 learned_addr learned my addr 172.21.15.103:0/1397000067 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2134074760 con 0x7f21341498c0 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f21340745e0 con 0x7f2134145880 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f7993fff640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7994141950 0x7f7994131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f79937fe640 1 -- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7994141950 msgr2=0x7f7994131e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f79937fe640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7994141950 0x7f7994131e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f79937fe640 1 -- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79940b3fc0 msgr2=0x7f799412f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f79937fe640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79940b3fc0 0x7f799412f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f79937fe640 1 -- 172.21.15.103:0/1122158868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799412f8b0 con 0x7f799406c7a0 2024-04-25T10:33:48.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fe4fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f8147ed0 0x7f08f81e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f21340b4910 con 0x7f21340b3fc0 2024-04-25T10:33:48.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fe4fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08f814ad30 0x7f08f81e0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fe4fc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f08f80bcab0 con 0x7f08f8147ed0 2024-04-25T10:33:48.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff395931640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3880349f0 0x7ff38802a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fe4fc640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f08f80bc930 con 0x7f08f814ad30 2024-04-25T10:33:48.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fe4fc640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f08f80bcc30 con 0x7f08f806c630 2024-04-25T10:33:48.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396933640 1 -- 172.21.15.103:0/151477575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff388033bd0 msgr2=0x7ff3880cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396933640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff388033bd0 0x7ff3880cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396933640 1 -- 172.21.15.103:0/151477575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3880349f0 msgr2=0x7ff38802a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396933640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3880349f0 0x7ff38802a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff396933640 1 -- 172.21.15.103:0/151477575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38802c300 con 0x7ff3880d1050 2024-04-25T10:33:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7ff395931640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3880349f0 0x7ff38802a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f79937fe640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799406c7a0 0x7f799413cc50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f798800d880 tx=0x7f798800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fd4fa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08f806c630 0x7f08f814a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fd4fa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08f806c630 0x7f08f814a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:46044/0 (socket says 172.21.15.103:46044) 2024-04-25T10:33:48.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fd4fa640 1 -- 172.21.15.103:0/2105347349 learned_addr learned my addr 172.21.15.103:0/2105347349 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7f08fdcfb640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08f814ad30 0x7f08f81e0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b15a67640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014a670 0x7f7b101e3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.174+0000 7fed5d969640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed500c48b0 0x7fed500c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b15a67640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b1014e180 0x7f7b100b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b15a67640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b10150fe0 0x7f7b10149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7ff396933640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3880d1050 0x7ff38802acc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff390051c90 tx=0x7ff39006eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f2139044640 1 -- 172.21.15.103:0/1397000067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21340b3fc0 msgr2=0x7f2134141aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:33:48.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f2139044640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21340b3fc0 0x7f2134141aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7fed5e16a640 1 -- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed500c48b0 msgr2=0x7fed500c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7fed5e16a640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed500c48b0 0x7fed500c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7fed5e16a640 1 -- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed500ce7f0 msgr2=0x7fed5015ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f2139044640 1 -- 172.21.15.103:0/1397000067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2134145880 msgr2=0x7f21340b5ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:33:48.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7fed5e16a640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed500ce7f0 0x7fed5015ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7fed5e16a640 1 -- 172.21.15.103:0/1763396539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed500c9670 con 0x7fed50037930 2024-04-25T10:33:48.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b1014e180 0x7f7b100b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b1014e180 0x7f7b100b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58778/0 (socket says 172.21.15.103:58778) 2024-04-25T10:33:48.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b0effd640 1 -- 172.21.15.103:0/1045994090 learned_addr learned my addr 172.21.15.103:0/1045994090 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f2139044640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2134145880 0x7f21340b5ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b15a67640 1 -- 172.21.15.103:0/1045994090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1014b310 con 0x7f7b1014a670 2024-04-25T10:33:48.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b15a67640 1 -- 172.21.15.103:0/1045994090 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1014b190 con 0x7f7b1014e180 2024-04-25T10:33:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f2139044640 1 -- 172.21.15.103:0/1397000067 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21340b6000 con 0x7f21341498c0 2024-04-25T10:33:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7fed5e96b640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed500ce7f0 0x7fed5015ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b0ffff640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b10150fe0 0x7f7b10149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b15a67640 1 -- 172.21.15.103:0/1045994090 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1014b490 con 0x7f7b10150fe0 2024-04-25T10:33:48.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fccf9640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f8147ed0 0x7f08f81e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fd4fa640 1 -- 172.21.15.103:0/2105347349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08f814ad30 msgr2=0x7f08f81e0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fd4fa640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08f814ad30 0x7f08f81e0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fd4fa640 1 -- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f8147ed0 msgr2=0x7f08f81e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fd4fa640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f8147ed0 0x7f08f81e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fd4fa640 1 -- 172.21.15.103:0/2105347349 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f81e4050 con 0x7f08f806c630 2024-04-25T10:33:48.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fccf9640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f8147ed0 0x7f08f81e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:48.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fd4fa640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08f806c630 0x7f08f814a280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ba50 tx=0x7f08e800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7fed5e16a640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50037930 0x7fed500ca190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed5400b7b0 tx=0x7fed5400bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f630e7fc640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62fc0744e0 0x7f62fc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f630e7fc640 1 -- 172.21.15.103:0/3484959312 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f63181315a0 con 0x7f63100cae60 2024-04-25T10:33:48.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f7b0f7fe640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014a670 0x7f7b101e3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08f5ffb640 1 -- 172.21.15.103:0/2105347349 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8019070 con 0x7f08f806c630 2024-04-25T10:33:48.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f2139044640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21341498c0 0x7f21340b1080 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f212800d9b0 tx=0x7f212800de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f80ba590 con 0x7f08f806c630 2024-04-25T10:33:48.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f08f5ffb640 1 -- 172.21.15.103:0/2105347349 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e800cc30 con 0x7f08f806c630 2024-04-25T10:33:48.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f08f5ffb640 1 -- 172.21.15.103:0/2105347349 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8014440 con 0x7f08f806c630 2024-04-25T10:33:48.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.175+0000 7f631d94e640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62fc0744e0 0x7f62fc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f631d94e640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62fc0744e0 0x7f62fc0769f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63100294c0 tx=0x7f6308008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7b0effd640 1 -- 172.21.15.103:0/1045994090 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b10150fe0 msgr2=0x7f7b10149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7b0effd640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b10150fe0 0x7f7b10149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7b0effd640 1 -- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014a670 msgr2=0x7f7b101e3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7b0effd640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014a670 0x7f7b101e3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7b0effd640 1 -- 172.21.15.103:0/1045994090 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b101e43b0 con 0x7f7b1014e180 2024-04-25T10:33:48.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7b0effd640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b1014e180 0x7f7b100b21a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b00000c00 tx=0x7f7b000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f8148440 con 0x7f08f806c630 2024-04-25T10:33:48.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7af7fff640 1 -- 172.21.15.103:0/1045994090 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00037040 con 0x7f7b1014e180 2024-04-25T10:33:48.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7af7fff640 1 -- 172.21.15.103:0/1045994090 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b00004230 con 0x7f7b1014e180 2024-04-25T10:33:48.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7af7fff640 1 -- 172.21.15.103:0/1045994090 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0002ae60 con 0x7f7b1014e180 2024-04-25T10:33:48.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7b15a67640 1 -- 172.21.15.103:0/1045994090 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b101e3690 con 0x7f7b1014e180 2024-04-25T10:33:48.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7f7b15a67640 1 -- 172.21.15.103:0/1045994090 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b101e3950 con 0x7f7b1014e180 2024-04-25T10:33:48.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7ff901f6b640 1 -- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8e4004800 msgr2=0x7ff8e4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7ff901f6b640 1 --2- 172.21.15.103:0/1255890829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8e4004800 0x7ff8e4004c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc070c10 tx=0x7ff8e4005830 comp rx=0 tx=0).stop 2024-04-25T10:33:48.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.176+0000 7ff8fbfff640 1 -- 172.21.15.103:0/1255890829 reap_dead start 2024-04-25T10:33:48.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.177+0000 7ff901f6b640 1 -- 172.21.15.103:0/1255890829 shutdown_connections 2024-04-25T10:33:48.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.177+0000 7ff901f6b640 1 -- 172.21.15.103:0/1255890829 >> 172.21.15.103:0/1255890829 conn(0x7ff8fc0b77a0 msgr2=0x7ff8fc0ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.177+0000 7ff901f6b640 1 -- 172.21.15.103:0/1255890829 shutdown_connections 2024-04-25T10:33:48.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.177+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f80be620 con 0x7f08f806c630 2024-04-25T10:33:48.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.178+0000 7f08f5ffb640 1 -- 172.21.15.103:0/2105347349 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f08e801c070 con 0x7f08f806c630 2024-04-25T10:33:48.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.177+0000 7ff901f6b640 1 -- 172.21.15.103:0/1255890829 wait complete. 2024-04-25T10:33:48.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7f7af7fff640 1 -- 172.21.15.103:0/1045994090 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f7b00003610 con 0x7f7b1014e180 2024-04-25T10:33:48.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7f08f5ffb640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f08e4074650 0x7f08e4076b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7f08f5ffb640 1 -- 172.21.15.103:0/2105347349 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f08e8094f40 con 0x7f08f806c630 2024-04-25T10:33:48.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7f7b15a67640 1 -- 172.21.15.103:0/1045994090 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1006a130 con 0x7f7b1014e180 2024-04-25T10:33:48.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7ff901f6b640 1 Processor -- start 2024-04-25T10:33:48.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7f08fccf9640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f08e4074650 0x7f08e4076b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7ff901f6b640 1 -- start start 2024-04-25T10:33:48.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7f7af7fff640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7afc0744b0 0x7f7afc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7f08fccf9640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f08e4074650 0x7f08e4076b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f08f8069160 tx=0x7f08f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.179+0000 7f7af7fff640 1 -- 172.21.15.103:0/1045994090 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7b000b5720 con 0x7f7b1014e180 2024-04-25T10:33:48.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7f7b0f7fe640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7afc0744b0 0x7f7afc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7f7b0f7fe640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7afc0744b0 0x7f7afc0769c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b080012e0 tx=0x7f7b08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff901f6b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4004800 0x7ff8fc0b2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff901f6b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8fc0b1e40 0x7ff8fc1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff901f6b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc142700 0x7ff8fc142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff901f6b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0b7d60 con 0x7ff8e4004800 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff901f6b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc0b7be0 con 0x7ff8fc0b1e40 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff901f6b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff8fc0b0200 con 0x7ff8fc142700 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff8fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4004800 0x7ff8fc0b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff8fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4004800 0x7ff8fc0b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48928/0 (socket says 172.21.15.103:48928) 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.180+0000 7ff8fb7fe640 1 -- 172.21.15.103:0/475702884 learned_addr learned my addr 172.21.15.103:0/475702884 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8faffd640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8fc0b1e40 0x7ff8fc1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8fbfff640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc142700 0x7ff8fc142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f630e7fc640 1 -- 172.21.15.103:0/3484959312 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f63100d1f20 con 0x7f63100cae60 2024-04-25T10:33:48.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8fb7fe640 1 -- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc142700 msgr2=0x7ff8fc142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8fb7fe640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc142700 0x7ff8fc142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8fb7fe640 1 -- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8fc0b1e40 msgr2=0x7ff8fc1491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8fb7fe640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8fc0b1e40 0x7ff8fc1491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8fb7fe640 1 -- 172.21.15.103:0/475702884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc0b3f20 con 0x7ff8e4004800 2024-04-25T10:33:48.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7fed4effd640 1 -- 172.21.15.103:0/1763396539 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed54019070 con 0x7fed50037930 2024-04-25T10:33:48.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8fbfff640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc142700 0x7ff8fc142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:48.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff8faffd640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8fc0b1e40 0x7ff8fc1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:48.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f21317fa640 1 -- 172.21.15.103:0/1397000067 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128015070 con 0x7f21341498c0 2024-04-25T10:33:48.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21341ded20 con 0x7f21341498c0 2024-04-25T10:33:48.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21341de330 con 0x7f21341498c0 2024-04-25T10:33:48.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7fed4effd640 1 -- 172.21.15.103:0/1763396539 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed5400c740 con 0x7fed50037930 2024-04-25T10:33:48.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed500c8880 con 0x7fed50037930 2024-04-25T10:33:48.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7fed4effd640 1 -- 172.21.15.103:0/1763396539 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5400cb30 con 0x7fed50037930 2024-04-25T10:33:48.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff386ffd640 1 -- 172.21.15.103:0/151477575 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39006ec50 con 0x7ff3880d1050 2024-04-25T10:33:48.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff386ffd640 1 -- 172.21.15.103:0/151477575 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39006ee10 con 0x7ff3880d1050 2024-04-25T10:33:48.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7ff386ffd640 1 -- 172.21.15.103:0/151477575 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39008cd70 con 0x7ff3880d1050 2024-04-25T10:33:48.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5003dba0 con 0x7fed50037930 2024-04-25T10:33:48.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.182+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38802eda0 con 0x7ff3880d1050 2024-04-25T10:33:48.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.182+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38802db20 con 0x7ff3880d1050 2024-04-25T10:33:48.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.182+0000 7ff8fb7fe640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4004800 0x7ff8fc0b2390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00b760 tx=0x7ff8ec00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.184+0000 7fed4effd640 1 -- 172.21.15.103:0/1763396539 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fed5401c070 con 0x7fed50037930 2024-04-25T10:33:48.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f797bfff640 1 -- 172.21.15.103:0/1122158868 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988004030 con 0x7f799406c7a0 2024-04-25T10:33:48.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f797bfff640 1 -- 172.21.15.103:0/1122158868 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79880041d0 con 0x7f799406c7a0 2024-04-25T10:33:48.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f797bfff640 1 -- 172.21.15.103:0/1122158868 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988004380 con 0x7f799406c7a0 2024-04-25T10:33:48.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7994133550 con 0x7f799406c7a0 2024-04-25T10:33:48.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.181+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7994133dc0 con 0x7f799406c7a0 2024-04-25T10:33:48.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.183+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff388005570 con 0x7ff3880d1050 2024-04-25T10:33:48.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.184+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799406a130 con 0x7f799406c7a0 2024-04-25T10:33:48.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.184+0000 7f21317fa640 1 -- 172.21.15.103:0/1397000067 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21280079c0 con 0x7f21341498c0 2024-04-25T10:33:48.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.184+0000 7f21317fa640 1 -- 172.21.15.103:0/1397000067 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212801f060 con 0x7f21341498c0 2024-04-25T10:33:48.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.185+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2114005290 con 0x7f21341498c0 2024-04-25T10:33:48.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.185+0000 7f797bfff640 1 -- 172.21.15.103:0/1122158868 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f798801b020 con 0x7f799406c7a0 2024-04-25T10:33:48.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.185+0000 7f7af7fff640 1 -- 172.21.15.103:0/1045994090 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b00042020 con 0x7f7b1014e180 2024-04-25T10:33:48.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.184+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed500c9840 con 0x7fed50037930 2024-04-25T10:33:48.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.184+0000 7fed4effd640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fed3c0744b0 0x7fed3c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.185+0000 7fed5d969640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fed3c0744b0 0x7fed3c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.185+0000 7fed5d969640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fed3c0744b0 0x7fed3c0769c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fed500c0b00 tx=0x7fed48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7f08f5ffb640 1 -- 172.21.15.103:0/2105347349 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08f80be620 con 0x7f08f806c630 2024-04-25T10:33:48.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7fed4effd640 1 -- 172.21.15.103:0/1763396539 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fed54094560 con 0x7fed50037930 2024-04-25T10:33:48.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.187+0000 7f21317fa640 1 -- 172.21.15.103:0/1397000067 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2128018070 con 0x7f21341498c0 2024-04-25T10:33:48.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7f797bfff640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7980074500 0x7f7980076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7f797bfff640 1 -- 172.21.15.103:0/1122158868 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7988094e90 con 0x7f799406c7a0 2024-04-25T10:33:48.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7f7992ffd640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7980074500 0x7f7980076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7f7992ffd640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7980074500 0x7f7980076a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f798c034000 tx=0x7f798c033040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.187+0000 7f21317fa640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f21200744b0 0x7f21200769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.187+0000 7f21317fa640 1 -- 172.21.15.103:0/1397000067 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2128095350 con 0x7f21341498c0 2024-04-25T10:33:48.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.188+0000 7f2138843640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f21200744b0 0x7f21200769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.188+0000 7f2138843640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f21200744b0 0x7f21200769c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2124037000 tx=0x7f2124008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7ff8e3fff640 1 -- 172.21.15.103:0/475702884 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00fcb0 con 0x7ff8e4004800 2024-04-25T10:33:48.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7ff8e3fff640 1 -- 172.21.15.103:0/475702884 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec01a070 con 0x7ff8e4004800 2024-04-25T10:33:48.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.186+0000 7ff8e3fff640 1 -- 172.21.15.103:0/475702884 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec015630 con 0x7ff8e4004800 2024-04-25T10:33:48.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.187+0000 7ff901f6b640 1 -- 172.21.15.103:0/475702884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc0b4200 con 0x7ff8e4004800 2024-04-25T10:33:48.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.187+0000 7ff901f6b640 1 -- 172.21.15.103:0/475702884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc0b2a00 con 0x7ff8e4004800 2024-04-25T10:33:48.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.188+0000 7ff8e1ffb640 1 -- 172.21.15.103:0/475702884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d4005290 con 0x7ff8e4004800 2024-04-25T10:33:48.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.188+0000 7ff386ffd640 1 -- 172.21.15.103:0/151477575 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff390076150 con 0x7ff3880d1050 2024-04-25T10:33:48.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.189+0000 7ff386ffd640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff3740744b0 0x7ff3740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.189+0000 7ff386ffd640 1 -- 172.21.15.103:0/151477575 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3901116b0 con 0x7ff3880d1050 2024-04-25T10:33:48.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.189+0000 7ff396132640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff3740744b0 0x7ff3740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.189+0000 7ff396132640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff3740744b0 0x7ff3740769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff3880cec60 tx=0x7ff380008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.194+0000 7ff386ffd640 1 -- 172.21.15.103:0/151477575 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3900dbf40 con 0x7ff3880d1050 2024-04-25T10:33:48.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.204+0000 7f797bfff640 1 -- 172.21.15.103:0/1122158868 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f798805f790 con 0x7f799406c7a0 2024-04-25T10:33:48.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.214+0000 7fed4effd640 1 -- 172.21.15.103:0/1763396539 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed5405e730 con 0x7fed50037930 2024-04-25T10:33:48.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.228+0000 7f21317fa640 1 -- 172.21.15.103:0/1397000067 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f212805faf0 con 0x7f21341498c0 2024-04-25T10:33:48.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.230+0000 7ff8e3fff640 1 -- 172.21.15.103:0/475702884 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff8ec0157d0 con 0x7ff8e4004800 2024-04-25T10:33:48.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.230+0000 7ff8e3fff640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff8e80744e0 0x7ff8e80769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:48.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.231+0000 7ff8e3fff640 1 -- 172.21.15.103:0/475702884 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff8ec05b6c0 con 0x7ff8e4004800 2024-04-25T10:33:48.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.232+0000 7ff8faffd640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff8e80744e0 0x7ff8e80769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:48.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.233+0000 7ff8faffd640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff8e80744e0 0x7ff8e80769f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc071dd0 tx=0x7ff8f0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:48.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.238+0000 7ff8e3fff640 1 -- 172.21.15.103:0/475702884 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff8ec012070 con 0x7ff8e4004800 2024-04-25T10:33:48.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.557+0000 7f6303fff640 1 -- 172.21.15.103:0/3484959312 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f63100c96c0 con 0x7f63100cae60 2024-04-25T10:33:48.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.557+0000 7f630e7fc640 1 -- 172.21.15.103:0/3484959312 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f63180c6020 con 0x7f63100cae60 2024-04-25T10:33:48.559 INFO:teuthology.orchestra.run.smithi103.stdout:55834574854 2024-04-25T10:33:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.560+0000 7f631e950640 1 -- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62fc0744e0 msgr2=0x7f62fc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.561+0000 7f631e950640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62fc0744e0 0x7f62fc0769f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63100294c0 tx=0x7f6308008040 comp rx=0 tx=0).stop 2024-04-25T10:33:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.561+0000 7f631e950640 1 -- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63100cae60 msgr2=0x7f63100330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.561+0000 7f631e950640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63100cae60 0x7f63100330f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6318065b40 tx=0x7f631806a640 comp rx=0 tx=0).stop 2024-04-25T10:33:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.561+0000 7f631e950640 1 -- 172.21.15.103:0/3484959312 shutdown_connections 2024-04-25T10:33:48.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.561+0000 7f631e950640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f62fc0744e0 0x7f62fc0769f0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f63100294c0 tx=0x7f6308008040 comp rx=0 tx=0).stop 2024-04-25T10:33:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.561+0000 7f631e950640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63100cae60 0x7f63100330f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.561+0000 7f631e950640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6310039db0 0x7f63100350a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.561+0000 7f631e950640 1 --2- 172.21.15.103:0/3484959312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6310031fa0 0x7f6310032b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.562+0000 7f631e950640 1 -- 172.21.15.103:0/3484959312 >> 172.21.15.103:0/3484959312 conn(0x7f631003b7b0 msgr2=0x7f6310004f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.562+0000 7f631e950640 1 -- 172.21.15.103:0/3484959312 shutdown_connections 2024-04-25T10:33:48.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.563+0000 7f631e950640 1 -- 172.21.15.103:0/3484959312 wait complete. 2024-04-25T10:33:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.566+0000 7f7b15a67640 1 -- 172.21.15.103:0/1045994090 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7b1014e8b0 con 0x7f7b1014e180 2024-04-25T10:33:48.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.567+0000 7f7af7fff640 1 -- 172.21.15.103:0/1045994090 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b0007f850 con 0x7f7b1014e180 2024-04-25T10:33:48.569 INFO:teuthology.orchestra.run.smithi103.stdout:55834574854 2024-04-25T10:33:48.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.570+0000 7f7af5ffb640 1 -- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7afc0744b0 msgr2=0x7f7afc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.570+0000 7f7af5ffb640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7afc0744b0 0x7f7afc0769c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b080012e0 tx=0x7f7b08009040 comp rx=0 tx=0).stop 2024-04-25T10:33:48.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.571+0000 7f7af5ffb640 1 -- 172.21.15.103:0/1045994090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b1014e180 msgr2=0x7f7b100b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.571+0000 7f7af5ffb640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b1014e180 0x7f7b100b21a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b00000c00 tx=0x7f7b000046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.572+0000 7f7af5ffb640 1 -- 172.21.15.103:0/1045994090 shutdown_connections 2024-04-25T10:33:48.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.572+0000 7f7af5ffb640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7afc0744b0 0x7f7afc0769c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.572+0000 7f7af5ffb640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7b10150fe0 0x7f7b10149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.572+0000 7f7af5ffb640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b1014e180 0x7f7b100b21a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.572+0000 7f7af5ffb640 1 --2- 172.21.15.103:0/1045994090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1014a670 0x7f7b101e3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.572+0000 7f7af5ffb640 1 -- 172.21.15.103:0/1045994090 >> 172.21.15.103:0/1045994090 conn(0x7f7b100b8120 msgr2=0x7f7b100b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.572+0000 7f7af5ffb640 1 -- 172.21.15.103:0/1045994090 shutdown_connections 2024-04-25T10:33:48.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.572+0000 7f7af5ffb640 1 -- 172.21.15.103:0/1045994090 wait complete. 2024-04-25T10:33:48.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-25T10:33:48.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-04-25T10:33:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.596+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f08f806d890 con 0x7f08f806c630 2024-04-25T10:33:48.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.596+0000 7f08f5ffb640 1 -- 172.21.15.103:0/2105347349 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08e805f840 con 0x7f08f806c630 2024-04-25T10:33:48.598 INFO:teuthology.orchestra.run.smithi103.stdout:55834574854 2024-04-25T10:33:48.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.599+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f08e4074650 msgr2=0x7f08e4076b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.599+0000 7f08fe4fc640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f08e4074650 0x7f08e4076b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f08f8069160 tx=0x7f08f0008040 comp rx=0 tx=0).stop 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.599+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08f806c630 msgr2=0x7f08f814a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.599+0000 7f08fe4fc640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08f806c630 0x7f08f814a280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ba50 tx=0x7f08e800bf10 comp rx=0 tx=0).stop 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.600+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 shutdown_connections 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.600+0000 7f08fe4fc640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f08e4074650 0x7f08e4076b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.600+0000 7f08fe4fc640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08f814ad30 0x7f08f81e0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.600+0000 7f08fe4fc640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f8147ed0 0x7f08f81e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.600+0000 7f08fe4fc640 1 --2- 172.21.15.103:0/2105347349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f08f806c630 0x7f08f814a280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.600+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 >> 172.21.15.103:0/2105347349 conn(0x7f08f80b8110 msgr2=0x7f08f8073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.600+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 shutdown_connections 2024-04-25T10:33:48.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.600+0000 7f08fe4fc640 1 -- 172.21.15.103:0/2105347349 wait complete. 2024-04-25T10:33:48.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.605+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff3880d00e0 con 0x7ff3880d1050 2024-04-25T10:33:48.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.606+0000 7ff386ffd640 1 -- 172.21.15.103:0/151477575 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3900db840 con 0x7ff3880d1050 2024-04-25T10:33:48.607 INFO:teuthology.orchestra.run.smithi103.stdout:55834574854 2024-04-25T10:33:48.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2114005850 con 0x7f21341498c0 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff3740744b0 msgr2=0x7ff3740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff3740744b0 0x7ff3740769c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff3880cec60 tx=0x7ff380008040 comp rx=0 tx=0).stop 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3880d1050 msgr2=0x7ff38802acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3880d1050 0x7ff38802acc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff390051c90 tx=0x7ff39006eb20 comp rx=0 tx=0).stop 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 shutdown_connections 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff3740744b0 0x7ff3740769c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3880d1050 0x7ff38802acc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3880349f0 0x7ff38802a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7f21317fa640 1 -- 172.21.15.103:0/1397000067 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f212805f3f0 con 0x7f21341498c0 2024-04-25T10:33:48.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 --2- 172.21.15.103:0/151477575 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff388033bd0 0x7ff3880cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 >> 172.21.15.103:0/151477575 conn(0x7ff38803b270 msgr2=0x7ff388005780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.612 INFO:teuthology.orchestra.run.smithi103.stdout:55834574854 2024-04-25T10:33:48.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 shutdown_connections 2024-04-25T10:33:48.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.609+0000 7ff397134640 1 -- 172.21.15.103:0/151477575 wait complete. 2024-04-25T10:33:48.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.611+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f21200744b0 msgr2=0x7f21200769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.611+0000 7f213aaa7640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f21200744b0 0x7f21200769c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2124037000 tx=0x7f2124008030 comp rx=0 tx=0).stop 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.611+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21341498c0 msgr2=0x7f21340b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.611+0000 7f213aaa7640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21341498c0 0x7f21340b1080 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f212800d9b0 tx=0x7f212800de70 comp rx=0 tx=0).stop 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.612+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 shutdown_connections 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.612+0000 7f213aaa7640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f21200744b0 0x7f21200769c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.612+0000 7f213aaa7640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21341498c0 0x7f21340b1080 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.612+0000 7f213aaa7640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2134145880 0x7f21340b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.612+0000 7f213aaa7640 1 --2- 172.21.15.103:0/1397000067 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21340b3fc0 0x7f2134141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.612+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 >> 172.21.15.103:0/1397000067 conn(0x7f213406ce50 msgr2=0x7f213406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.612+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 shutdown_connections 2024-04-25T10:33:48.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.612+0000 7f213aaa7640 1 -- 172.21.15.103:0/1397000067 wait complete. 2024-04-25T10:33:48.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-25T10:33:48.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.621+0000 7ff8e1ffb640 1 -- 172.21.15.103:0/475702884 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff8d4005850 con 0x7ff8e4004800 2024-04-25T10:33:48.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.621+0000 7ff8e3fff640 1 -- 172.21.15.103:0/475702884 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8ec05f0d0 con 0x7ff8e4004800 2024-04-25T10:33:48.622 INFO:teuthology.orchestra.run.smithi103.stdout:55834574854 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.623+0000 7ff8e1ffb640 1 -- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff8e80744e0 msgr2=0x7ff8e80769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.623+0000 7ff8e1ffb640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff8e80744e0 0x7ff8e80769f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc071dd0 tx=0x7ff8f0009030 comp rx=0 tx=0).stop 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.623+0000 7ff8e1ffb640 1 -- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4004800 msgr2=0x7ff8fc0b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.623+0000 7ff8e1ffb640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4004800 0x7ff8fc0b2390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00b760 tx=0x7ff8ec00f4a0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.623+0000 7ff8e1ffb640 1 -- 172.21.15.103:0/475702884 shutdown_connections 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.623+0000 7ff8e1ffb640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff8e80744e0 0x7ff8e80769f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.623+0000 7ff8e1ffb640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff8fc142700 0x7ff8fc142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.623+0000 7ff8e1ffb640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8fc0b1e40 0x7ff8fc1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.624+0000 7ff8e1ffb640 1 --2- 172.21.15.103:0/475702884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e4004800 0x7ff8fc0b2390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.624+0000 7ff8e1ffb640 1 -- 172.21.15.103:0/475702884 >> 172.21.15.103:0/475702884 conn(0x7ff8fc0b77a0 msgr2=0x7ff8fc075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.624+0000 7ff8e1ffb640 1 -- 172.21.15.103:0/475702884 shutdown_connections 2024-04-25T10:33:48.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.624+0000 7ff8e1ffb640 1 -- 172.21.15.103:0/475702884 wait complete. 2024-04-25T10:33:48.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-25T10:33:48.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.625+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7994140ea0 con 0x7f799406c7a0 2024-04-25T10:33:48.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.625+0000 7f797bfff640 1 -- 172.21.15.103:0/1122158868 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f798805f090 con 0x7f799406c7a0 2024-04-25T10:33:48.628 INFO:teuthology.orchestra.run.smithi103.stdout:55834574854 2024-04-25T10:33:48.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-25T10:33:48.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.627+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fed500059c0 con 0x7fed50037930 2024-04-25T10:33:48.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.627+0000 7fed4effd640 1 -- 172.21.15.103:0/1763396539 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed54062a30 con 0x7fed50037930 2024-04-25T10:33:48.630 INFO:teuthology.orchestra.run.smithi103.stdout:55834574854 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7980074500 msgr2=0x7f7980076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7980074500 0x7f7980076a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f798c034000 tx=0x7f798c033040 comp rx=0 tx=0).stop 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799406c7a0 msgr2=0x7f799413cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799406c7a0 0x7f799413cc50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f798800d880 tx=0x7f798800dd40 comp rx=0 tx=0).stop 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 shutdown_connections 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f7980074500 0x7f7980076a10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7994141950 0x7f7994131e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79940b3fc0 0x7f799412f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 --2- 172.21.15.103:0/1122158868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799406c7a0 0x7f799413cc50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 >> 172.21.15.103:0/1122158868 conn(0x7f79940bc9a0 msgr2=0x7f799406e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 shutdown_connections 2024-04-25T10:33:48.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.628+0000 7f799a1f3640 1 -- 172.21.15.103:0/1122158868 wait complete. 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fed3c0744b0 msgr2=0x7fed3c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fed3c0744b0 0x7fed3c0769c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fed500c0b00 tx=0x7fed48008040 comp rx=0 tx=0).stop 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50037930 msgr2=0x7fed500ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50037930 0x7fed500ca190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed5400b7b0 tx=0x7fed5400bc70 comp rx=0 tx=0).stop 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 shutdown_connections 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fed3c0744b0 0x7fed3c0769c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed500ce7f0 0x7fed5015ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed500c48b0 0x7fed500c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 --2- 172.21.15.103:0/1763396539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed50037930 0x7fed500ca190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 >> 172.21.15.103:0/1763396539 conn(0x7fed5003b6c0 msgr2=0x7fed500cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 shutdown_connections 2024-04-25T10:33:48.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:48.630+0000 7fed5f16c640 1 -- 172.21.15.103:0/1763396539 wait complete. 2024-04-25T10:33:48.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-04-25T10:33:48.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-25T10:33:48.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-25T10:33:49.583 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T10:33:49.591 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T10:33:49.619 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T10:33:49.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T10:33:49.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T10:33:49.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T10:33:49.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T10:33:49.646 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T10:33:49.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.736+0000 7f8f4359e640 1 Processor -- start 2024-04-25T10:33:49.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.736+0000 7f8f4359e640 1 -- start start 2024-04-25T10:33:49.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.738+0000 7f8f4359e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8f3c039db0 0x7f8f3c03a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.738+0000 7f8f4359e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8f3c0cae60 0x7f8f3c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.738+0000 7f8f4359e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c03a700 con 0x7f8f3c031fa0 2024-04-25T10:33:49.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.738+0000 7f8f4359e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8f3c01e2d0 con 0x7f8f3c0cae60 2024-04-25T10:33:49.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.738+0000 7f8f4359e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f8f3c0323b0 con 0x7f8f3c039db0 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.738+0000 7f8f42d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8f3c0cae60 0x7f8f3c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.739+0000 7f8f42d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8f3c0cae60 0x7f8f3c0cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48942/0 (socket says 172.21.15.103:48942) 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.739+0000 7f8f42d9d640 1 -- 172.21.15.103:0/1605607993 learned_addr learned my addr 172.21.15.103:0/1605607993 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.739+0000 7f8f42d9d640 1 -- 172.21.15.103:0/1605607993 >> v2:172.21.15.132:3300/0 conn(0x7f8f3c039db0 msgr2=0x7f8f3c03a1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.739+0000 7f8f42d9d640 1 --2- 172.21.15.103:0/1605607993 >> v2:172.21.15.132:3300/0 conn(0x7f8f3c039db0 0x7f8f3c03a1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.739+0000 7f8f42d9d640 1 -- 172.21.15.103:0/1605607993 >> v1:172.21.15.103:6789/0 conn(0x7f8f3c031fa0 legacy=0x7f8f3c01c360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.739+0000 7f8f42d9d640 1 -- 172.21.15.103:0/1605607993 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c01dc80 con 0x7f8f3c0cae60 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.740+0000 7f8f42d9d640 1 --2- 172.21.15.103:0/1605607993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cae60 0x7f8f3c0cb270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8f4406af20 tx=0x7f8f440a6ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3d9bdbe690ff30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.741+0000 7f8f4159a640 1 -- 172.21.15.103:0/1605607993 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440b4070 con 0x7f8f3c0cae60 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.741+0000 7f8f4159a640 1 -- 172.21.15.103:0/1605607993 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f440a7ad0 con 0x7f8f3c0cae60 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.742+0000 7f8f4359e640 1 -- 172.21.15.103:0/1605607993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cae60 msgr2=0x7f8f3c0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.742+0000 7f8f4359e640 1 --2- 172.21.15.103:0/1605607993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cae60 0x7f8f3c0cb270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8f4406af20 tx=0x7f8f440a6ed0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.742+0000 7f8f4359e640 1 -- 172.21.15.103:0/1605607993 shutdown_connections 2024-04-25T10:33:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.742+0000 7f8f4359e640 1 --2- 172.21.15.103:0/1605607993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cae60 0x7f8f3c0cb270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.742+0000 7f8f4359e640 1 --2- 172.21.15.103:0/1605607993 >> v2:172.21.15.132:3300/0 conn(0x7f8f3c039db0 0x7f8f3c03a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.742+0000 7f8f4359e640 1 -- 172.21.15.103:0/1605607993 >> 172.21.15.103:0/1605607993 conn(0x7f8f3c03b7b0 msgr2=0x7f8f3c03bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.742+0000 7f8f4359e640 1 -- 172.21.15.103:0/1605607993 shutdown_connections 2024-04-25T10:33:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.742+0000 7f8f4359e640 1 -- 172.21.15.103:0/1605607993 wait complete. 2024-04-25T10:33:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.745+0000 7f8f4359e640 1 Processor -- start 2024-04-25T10:33:49.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.745+0000 7f8f4359e640 1 -- start start 2024-04-25T10:33:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.747+0000 7f8f4359e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f3c031fa0 0x7f8f3c0cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.747+0000 7f8f4359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f3c039db0 0x7f8f3c0d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.747+0000 7f8f4359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cbc30 0x7f8f3c0d9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.747+0000 7f8f41d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f3c039db0 0x7f8f3c0d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.747+0000 7f8f41d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f3c039db0 0x7f8f3c0d12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58792/0 (socket says 172.21.15.103:58792) 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f42d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cbc30 0x7f8f3c0d9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f4259c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f3c031fa0 0x7f8f3c0cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f4259c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f3c031fa0 0x7f8f3c0cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:46070/0 (socket says 172.21.15.103:46070) 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f42d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cbc30 0x7f8f3c0d9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48950/0 (socket says 172.21.15.103:48950) 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f41d9b640 1 -- 172.21.15.103:0/2772854823 learned_addr learned my addr 172.21.15.103:0/2772854823 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f4359e640 1 -- 172.21.15.103:0/2772854823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c03b560 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f4359e640 1 -- 172.21.15.103:0/2772854823 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c01ca70 con 0x7f8f3c039db0 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f4359e640 1 -- 172.21.15.103:0/2772854823 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f8f3c0cb7b0 con 0x7f8f3c031fa0 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f42d9d640 1 -- 172.21.15.103:0/2772854823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f3c031fa0 msgr2=0x7f8f3c0cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f42d9d640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f3c031fa0 0x7f8f3c0cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f42d9d640 1 -- 172.21.15.103:0/2772854823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f3c039db0 msgr2=0x7f8f3c0d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f42d9d640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f3c039db0 0x7f8f3c0d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.748+0000 7f8f42d9d640 1 -- 172.21.15.103:0/2772854823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c0cd2d0 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.749+0000 7f8f42d9d640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cbc30 0x7f8f3c0d9fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8f44076fa0 tx=0x7f8f4406a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.749+0000 7f8f32ffd640 1 -- 172.21.15.103:0/2772854823 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440b4050 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.749+0000 7f8f4359e640 1 -- 172.21.15.103:0/2772854823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c0cc150 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.749+0000 7f8f4359e640 1 -- 172.21.15.103:0/2772854823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c0d1e80 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.752+0000 7f8f4359e640 1 -- 172.21.15.103:0/2772854823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c0059c0 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.757+0000 7f8f32ffd640 1 -- 172.21.15.103:0/2772854823 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f440b5040 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.757+0000 7f8f32ffd640 1 -- 172.21.15.103:0/2772854823 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44068900 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.757+0000 7f8f32ffd640 1 -- 172.21.15.103:0/2772854823 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8f440a7bc0 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.758+0000 7f8f32ffd640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8f240745b0 0x7f8f24076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.758+0000 7f8f32ffd640 1 -- 172.21.15.103:0/2772854823 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8f441326c0 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.763+0000 7f8f4259c640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8f240745b0 0x7f8f24076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.763+0000 7f8f4259c640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8f240745b0 0x7f8f24076ac0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0294c0 tx=0x7f8f38009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.764+0000 7f8f32ffd640 1 -- 172.21.15.103:0/2772854823 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8f440fc7e0 con 0x7f8f3c0cbc30 2024-04-25T10:33:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.794+0000 7f952a2f2640 1 Processor -- start 2024-04-25T10:33:49.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.795+0000 7f952a2f2640 1 -- start start 2024-04-25T10:33:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.796+0000 7fbbb39c0640 1 Processor -- start 2024-04-25T10:33:49.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.796+0000 7fbbb39c0640 1 -- start start 2024-04-25T10:33:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.796+0000 7f952a2f2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f952406c7a0 0x7f9524071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.796+0000 7f952a2f2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9524072510 0x7f9524147780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.796+0000 7f952a2f2640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95240737e0 con 0x7f9524147cc0 2024-04-25T10:33:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.796+0000 7f952a2f2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9524073ac0 con 0x7f952406c7a0 2024-04-25T10:33:49.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7fbbb39c0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7fbbb39c0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbac147fa0 0x7fbbac0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7fbbb39c0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbac0b13c0 con 0x7fbbac0b0f00 2024-04-25T10:33:49.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7fbbb39c0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbbac072160 con 0x7fbbac147fa0 2024-04-25T10:33:49.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7fbbb39c0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac14db60 con 0x7fbbac147b90 2024-04-25T10:33:49.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.796+0000 7f952a2f2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f9524073da0 con 0x7f9524072510 2024-04-25T10:33:49.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.797+0000 7f952888f640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9524147cc0 0x7f9524151010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33104/0 (socket says 172.21.15.103:33104) 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.797+0000 7f952888f640 1 -- 172.21.15.103:0/473837428 learned_addr learned my addr 172.21.15.103:0/473837428 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.797+0000 7f9523fff640 1 --2- 172.21.15.103:0/473837428 >> v2:172.21.15.132:3300/0 conn(0x7f952406c7a0 0x7f9524071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7f95237fe640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9524072510 0x7f9524147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530696867 0 0) 0x7f95240737e0 con 0x7f9524147cc0 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f950c003520 con 0x7f9524147cc0 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.798+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2253379007 0 0) 0x7f950c003520 con 0x7f9524147cc0 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9524072510 msgr2=0x7f9524147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9524072510 0x7f9524147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 >> v2:172.21.15.132:3300/0 conn(0x7f952406c7a0 msgr2=0x7f9524071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 --2- 172.21.15.103:0/473837428 >> v2:172.21.15.132:3300/0 conn(0x7f952406c7a0 0x7f9524071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952406cbb0 con 0x7f9524147cc0 2024-04-25T10:33:49.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f951c0019f0 con 0x7f9524147cc0 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 >> v1:172.21.15.103:6789/0 conn(0x7f9524147cc0 legacy=0x7f9524151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f950c0039b0 0x7f950c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c004800 0x7f950c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f950c005270 0x7f950c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9524073ac0 con 0x7f950c004800 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9524073da0 con 0x7f950c0039b0 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f950c00c170 con 0x7f950c005270 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7fbbb1f5d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbbac0b0f00 0x7fbbac14e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.103:48010/0 (socket says 172.21.15.103:48010) 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7fbbb1f5d640 1 -- 172.21.15.103:0/1703391283 learned_addr learned my addr 172.21.15.103:0/1703391283 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:49.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7fbbb0f5b640 1 --2- 172.21.15.103:0/1703391283 >> v2:172.21.15.132:3300/0 conn(0x7fbbac147fa0 0x7fbbac0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7fbbb175c640 1 --2- 172.21.15.103:0/1703391283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f95237fe640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c004800 0x7f950c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f952888f640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f950c005270 0x7f950c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.799+0000 7f9523fff640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f950c0039b0 0x7f950c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7f9523fff640 1 -- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f950c005270 msgr2=0x7f950c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7fbbb0f5b640 1 -- 172.21.15.103:0/1703391283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 msgr2=0x7fbbac0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7fbbb0f5b640 1 --2- 172.21.15.103:0/1703391283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7fbbb0f5b640 1 -- 172.21.15.103:0/1703391283 >> v1:172.21.15.132:6789/0 conn(0x7fbbac0b0f00 legacy=0x7fbbac14e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7fbbb0f5b640 1 -- 172.21.15.103:0/1703391283 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac0b16a0 con 0x7fbbac147fa0 2024-04-25T10:33:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7f9523fff640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f950c005270 0x7f950c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7f9523fff640 1 -- 172.21.15.103:0/473837428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c004800 msgr2=0x7f950c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7f9523fff640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c004800 0x7f950c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7f9523fff640 1 -- 172.21.15.103:0/473837428 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952406cbb0 con 0x7f950c0039b0 2024-04-25T10:33:49.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.800+0000 7f95237fe640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f950c004800 0x7f950c004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:49.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.801+0000 7fbbb0f5b640 1 --2- 172.21.15.103:0/1703391283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac147fa0 0x7fbbac0b09c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbba80097a0 tx=0x7fbba8029f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c69aeff6b197dcf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.802+0000 7fbba3fff640 1 -- 172.21.15.103:0/1703391283 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8037070 con 0x7fbbac147fa0 2024-04-25T10:33:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.802+0000 7fbba3fff640 1 -- 172.21.15.103:0/1703391283 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba802ac10 con 0x7fbbac147fa0 2024-04-25T10:33:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.802+0000 7fbba3fff640 1 -- 172.21.15.103:0/1703391283 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8032440 con 0x7fbbac147fa0 2024-04-25T10:33:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.802+0000 7f9523fff640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f950c0039b0 0x7f950c003e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f951800ba00 tx=0x7f950c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7527e4edc7afb737 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.802+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518030070 con 0x7f950c0039b0 2024-04-25T10:33:49.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.803+0000 7f9522ffd640 1 -- 172.21.15.103:0/473837428 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951802adc0 con 0x7f950c0039b0 2024-04-25T10:33:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.803+0000 7fbbb39c0640 1 -- 172.21.15.103:0/1703391283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac147fa0 msgr2=0x7fbbac0b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.803+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/1703391283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac147fa0 0x7fbbac0b09c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbba80097a0 tx=0x7fbba8029f80 comp rx=0 tx=0).stop 2024-04-25T10:33:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7f952a2f2640 1 -- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f950c0039b0 msgr2=0x7f950c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7f952a2f2640 1 --2- 172.21.15.103:0/473837428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f950c0039b0 0x7f950c003e20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f951800ba00 tx=0x7f950c005830 comp rx=0 tx=0).stop 2024-04-25T10:33:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7f952888f640 1 -- 172.21.15.103:0/473837428 reap_dead start 2024-04-25T10:33:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7f952a2f2640 1 -- 172.21.15.103:0/473837428 shutdown_connections 2024-04-25T10:33:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7f952a2f2640 1 -- 172.21.15.103:0/473837428 >> 172.21.15.103:0/473837428 conn(0x7f95240b80d0 msgr2=0x7f952406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:49.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.805+0000 7f952a2f2640 1 -- 172.21.15.103:0/473837428 shutdown_connections 2024-04-25T10:33:49.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7fbbb39c0640 1 -- 172.21.15.103:0/1703391283 shutdown_connections 2024-04-25T10:33:49.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/1703391283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac147fa0 0x7fbbac0b09c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/1703391283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7fbbb39c0640 1 -- 172.21.15.103:0/1703391283 >> 172.21.15.103:0/1703391283 conn(0x7fbbac0b77a0 msgr2=0x7fbbac0ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7fbbb39c0640 1 -- 172.21.15.103:0/1703391283 shutdown_connections 2024-04-25T10:33:49.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.804+0000 7fbbb39c0640 1 -- 172.21.15.103:0/1703391283 wait complete. 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.807+0000 7fbbb39c0640 1 Processor -- start 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.807+0000 7fbbb39c0640 1 -- start start 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.808+0000 7fbbb39c0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.808+0000 7fbbb39c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac09bf00 0x7fbbac0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb39c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbac1495f0 0x7fbbac149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb0f5b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac09bf00 0x7fbbac0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb0f5b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac09bf00 0x7fbbac0b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58828/0 (socket says 172.21.15.103:58828) 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb1f5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbac1495f0 0x7fbbac149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb1f5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbac1495f0 0x7fbbac149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48956/0 (socket says 172.21.15.103:48956) 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb175c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb175c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0b44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:46108/0 (socket says 172.21.15.103:46108) 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb0f5b640 1 -- 172.21.15.103:0/3264691973 learned_addr learned my addr 172.21.15.103:0/3264691973 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac14e910 con 0x7fbbac1495f0 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac14e790 con 0x7fbbac09bf00 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac158310 con 0x7fbbac147b90 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7fbbb1f5d640 1 -- 172.21.15.103:0/3264691973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 msgr2=0x7fbbac0b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7fbbb1f5d640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7fbbb1f5d640 1 -- 172.21.15.103:0/3264691973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac09bf00 msgr2=0x7fbbac0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7fbbb1f5d640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac09bf00 0x7fbbac0b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7fbbb1f5d640 1 -- 172.21.15.103:0/3264691973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac0b4200 con 0x7fbbac1495f0 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7fbbb1f5d640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbac1495f0 0x7fbbac149a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbba400c770 tx=0x7fbba400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.812+0000 7fbba1ffb640 1 -- 172.21.15.103:0/3264691973 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4018070 con 0x7fbbac1495f0 2024-04-25T10:33:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.805+0000 7f952a2f2640 1 -- 172.21.15.103:0/473837428 wait complete. 2024-04-25T10:33:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.807+0000 7f952a2f2640 1 Processor -- start 2024-04-25T10:33:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.808+0000 7f952a2f2640 1 -- start start 2024-04-25T10:33:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7f952a2f2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f950c0039b0 0x7f95241d9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7f952a2f2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f952408c060 0x7f95241d7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.809+0000 7f952a2f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f952413eb10 0x7f952413ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7f95237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f952408c060 0x7f95241d7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.812+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac0b3f20 con 0x7fbbac1495f0 2024-04-25T10:33:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.812+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac14ab50 con 0x7fbbac1495f0 2024-04-25T10:33:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.812+0000 7fbba1ffb640 1 -- 172.21.15.103:0/3264691973 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba400a640 con 0x7fbbac1495f0 2024-04-25T10:33:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.812+0000 7fbba1ffb640 1 -- 172.21.15.103:0/3264691973 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba400aa30 con 0x7fbbac1495f0 2024-04-25T10:33:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7f95237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f952408c060 0x7f95241d7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48962/0 (socket says 172.21.15.103:48962) 2024-04-25T10:33:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7f952a2f2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9524147780 con 0x7f952408c060 2024-04-25T10:33:49.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7f952a2f2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9524151930 con 0x7f952413eb10 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7f952a2f2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f9524147900 con 0x7f950c0039b0 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7f95237fe640 1 -- 172.21.15.103:0/3546693716 learned_addr learned my addr 172.21.15.103:0/3546693716 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.810+0000 7f952888f640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f952413eb10 0x7f952413ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.811+0000 7f95237fe640 1 -- 172.21.15.103:0/3546693716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f950c0039b0 msgr2=0x7f95241d9120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.811+0000 7f95237fe640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f950c0039b0 0x7f95241d9120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.811+0000 7f95237fe640 1 -- 172.21.15.103:0/3546693716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f952413eb10 msgr2=0x7f952413ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.811+0000 7f95237fe640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f952413eb10 0x7f952413ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.811+0000 7f95237fe640 1 -- 172.21.15.103:0/3546693716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95240b3be0 con 0x7f952408c060 2024-04-25T10:33:49.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.811+0000 7f95237fe640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f952408c060 0x7f95241d7180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95140039b0 tx=0x7f9514003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.814+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c005290 con 0x7fbbac1495f0 2024-04-25T10:33:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.816+0000 7fbba1ffb640 1 -- 172.21.15.103:0/3264691973 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbba401b070 con 0x7fbbac1495f0 2024-04-25T10:33:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.817+0000 7fbba1ffb640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb90074580 0x7fbb90076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.817+0000 7fbba1ffb640 1 -- 172.21.15.103:0/3264691973 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbba4094cb0 con 0x7fbbac1495f0 2024-04-25T10:33:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.817+0000 7fbbb175c640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb90074580 0x7fbb90076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.818+0000 7fbbb175c640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb90074580 0x7fbb90076a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0b4c50 tx=0x7fbb9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.818+0000 7f9520ff9640 1 -- 172.21.15.103:0/3546693716 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514018070 con 0x7f952408c060 2024-04-25T10:33:49.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.818+0000 7f9520ff9640 1 -- 172.21.15.103:0/3546693716 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9514010890 con 0x7f952408c060 2024-04-25T10:33:49.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.818+0000 7f9520ff9640 1 -- 172.21.15.103:0/3546693716 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514010c40 con 0x7f952408c060 2024-04-25T10:33:49.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.819+0000 7f952a2f2640 1 -- 172.21.15.103:0/3546693716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95240b3e60 con 0x7f952408c060 2024-04-25T10:33:49.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.820+0000 7f952a2f2640 1 -- 172.21.15.103:0/3546693716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9524150920 con 0x7f952408c060 2024-04-25T10:33:49.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.821+0000 7f950a7fc640 1 -- 172.21.15.103:0/3546693716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952406a130 con 0x7f952408c060 2024-04-25T10:33:49.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.825+0000 7fbba1ffb640 1 -- 172.21.15.103:0/3264691973 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbba4022020 con 0x7fbbac1495f0 2024-04-25T10:33:49.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.835+0000 7f9520ff9640 1 -- 172.21.15.103:0/3546693716 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f951401b070 con 0x7f952408c060 2024-04-25T10:33:49.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.836+0000 7f9520ff9640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9510074530 0x7f9510076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.839+0000 7f9523fff640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9510074530 0x7f9510076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.840+0000 7f9523fff640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9510074530 0x7f9510076a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f950c0057e0 tx=0x7f9518030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.840+0000 7f9520ff9640 1 -- 172.21.15.103:0/3546693716 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f951405c210 con 0x7f952408c060 2024-04-25T10:33:49.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.840+0000 7f9520ff9640 1 -- 172.21.15.103:0/3546693716 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95240b3be0 con 0x7f952408c060 2024-04-25T10:33:49.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.855+0000 7f89d57da640 1 Processor -- start 2024-04-25T10:33:49.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.855+0000 7f89d57da640 1 -- start start 2024-04-25T10:33:49.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.856+0000 7f89d57da640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d00aff60 0x7f89d006d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.856+0000 7f89d57da640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89d009d360 0x7f89d014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.856+0000 7f89d57da640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d0151230 con 0x7f89d014d920 2024-04-25T10:33:49.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.856+0000 7f89d57da640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f89d00b1e40 con 0x7f89d009d360 2024-04-25T10:33:49.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.856+0000 7f89d57da640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f89d0151880 con 0x7f89d00aff60 2024-04-25T10:33:49.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.857+0000 7f89d4fd9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89d009d360 0x7f89d014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.857+0000 7f89d4fd9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89d009d360 0x7f89d014dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48970/0 (socket says 172.21.15.103:48970) 2024-04-25T10:33:49.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.857+0000 7f89d4fd9640 1 -- 172.21.15.103:0/3960897427 learned_addr learned my addr 172.21.15.103:0/3960897427 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.857+0000 7f89cffff640 1 --2- 172.21.15.103:0/3960897427 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d00aff60 0x7f89d006d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.857+0000 7f89d4fd9640 1 -- 172.21.15.103:0/3960897427 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d00aff60 msgr2=0x7f89d006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.857+0000 7f89d4fd9640 1 --2- 172.21.15.103:0/3960897427 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d00aff60 0x7f89d006d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.858+0000 7f89d4fd9640 1 -- 172.21.15.103:0/3960897427 >> v1:172.21.15.132:6789/0 conn(0x7f89d014d920 legacy=0x7f89d009cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.858+0000 7f89d4fd9640 1 -- 172.21.15.103:0/3960897427 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d0151510 con 0x7f89d009d360 2024-04-25T10:33:49.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.858+0000 7f89cffff640 1 --2- 172.21.15.103:0/3960897427 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d00aff60 0x7f89d006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:49.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.859+0000 7fe74ae80640 1 Processor -- start 2024-04-25T10:33:49.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.859+0000 7f89d4fd9640 1 --2- 172.21.15.103:0/3960897427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d009d360 0x7f89d014dd30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009870 tx=0x7f89c002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb10bf91a508dde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.859+0000 7f89ceffd640 1 -- 172.21.15.103:0/3960897427 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0037070 con 0x7f89d009d360 2024-04-25T10:33:49.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.859+0000 7f89ceffd640 1 -- 172.21.15.103:0/3960897427 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c0032440 con 0x7f89d009d360 2024-04-25T10:33:49.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.859+0000 7fe74ae80640 1 -- start start 2024-04-25T10:33:49.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7f89d57da640 1 -- 172.21.15.103:0/3960897427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d009d360 msgr2=0x7f89d014dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7f89d57da640 1 --2- 172.21.15.103:0/3960897427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d009d360 0x7f89d014dd30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009870 tx=0x7f89c002a230 comp rx=0 tx=0).stop 2024-04-25T10:33:49.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7fe74ae80640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0383e0 0x7fe73c0387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7fe74ae80640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe73c0c9a10 0x7fe73c0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7fe74ae80640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73c0371e0 con 0x7fe73c035b50 2024-04-25T10:33:49.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7fe74ae80640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe73c0c41d0 con 0x7fe73c0c9a10 2024-04-25T10:33:49.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7fe74ae80640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fe73c0374c0 con 0x7fe73c0383e0 2024-04-25T10:33:49.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7fe74a67f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe73c0c9a10 0x7fe73c0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7fe74a67f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe73c0c9a10 0x7fe73c0c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48972/0 (socket says 172.21.15.103:48972) 2024-04-25T10:33:49.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7fe74a67f640 1 -- 172.21.15.103:0/1868506485 learned_addr learned my addr 172.21.15.103:0/1868506485 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7f89d57da640 1 -- 172.21.15.103:0/3960897427 shutdown_connections 2024-04-25T10:33:49.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7f89d57da640 1 --2- 172.21.15.103:0/3960897427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d009d360 0x7f89d014dd30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7f89d57da640 1 --2- 172.21.15.103:0/3960897427 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d00aff60 0x7f89d006d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.861+0000 7f89d57da640 1 -- 172.21.15.103:0/3960897427 >> 172.21.15.103:0/3960897427 conn(0x7f89d006f180 msgr2=0x7f89d006f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:49.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.862+0000 7f89d57da640 1 -- 172.21.15.103:0/3960897427 shutdown_connections 2024-04-25T10:33:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.862+0000 7fe74a67f640 1 -- 172.21.15.103:0/1868506485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0383e0 msgr2=0x7fe73c0387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.862+0000 7fe74967d640 1 --2- 172.21.15.103:0/1868506485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0383e0 0x7fe73c0387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.862+0000 7fe748e7c640 1 -- 172.21.15.103:0/1868506485 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309008138 0 0) 0x7fe73c0371e0 con 0x7fe73c035b50 2024-04-25T10:33:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.862+0000 7fe74a67f640 1 --2- 172.21.15.103:0/1868506485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0383e0 0x7fe73c0387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.862+0000 7fe74a67f640 1 -- 172.21.15.103:0/1868506485 >> v1:172.21.15.103:6789/0 conn(0x7fe73c035b50 legacy=0x7fe73c034bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.863+0000 7fe74a67f640 1 -- 172.21.15.103:0/1868506485 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c0377a0 con 0x7fe73c0c9a10 2024-04-25T10:33:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.863+0000 7fe74967d640 1 --2- 172.21.15.103:0/1868506485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0383e0 0x7fe73c0387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.863+0000 7f0674c84640 1 Processor -- start 2024-04-25T10:33:49.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.864+0000 7fe74a67f640 1 --2- 172.21.15.103:0/1868506485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0c9a10 0x7fe73c0c9e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe734009870 tx=0x7fe73402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416b8814efb9e22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.862+0000 7f89d57da640 1 -- 172.21.15.103:0/3960897427 wait complete. 2024-04-25T10:33:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.864+0000 7f89d57da640 1 Processor -- start 2024-04-25T10:33:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.865+0000 7f89d57da640 1 -- start start 2024-04-25T10:33:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.865+0000 7fe748e7c640 1 -- 172.21.15.103:0/1868506485 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734037070 con 0x7fe73c0c9a10 2024-04-25T10:33:49.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.865+0000 7fe748e7c640 1 -- 172.21.15.103:0/1868506485 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe734032440 con 0x7fe73c0c9a10 2024-04-25T10:33:49.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.865+0000 7fe748e7c640 1 -- 172.21.15.103:0/1868506485 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734037070 con 0x7fe73c0c9a10 2024-04-25T10:33:49.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.864+0000 7fbb4ec68640 1 Processor -- start 2024-04-25T10:33:49.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.864+0000 7fbb4ec68640 1 -- start start 2024-04-25T10:33:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.863+0000 7f0674c84640 1 -- start start 2024-04-25T10:33:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.865+0000 7f0674c84640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0670151720 0x7f0670147b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.865+0000 7f0674c84640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06700737e0 con 0x7f067006c7a0 2024-04-25T10:33:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.865+0000 7f0674c84640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0670073ac0 con 0x7f0670147780 2024-04-25T10:33:49.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.865+0000 7f0674c84640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f0670073da0 con 0x7f0670151720 2024-04-25T10:33:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fbb4ec68640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb40037bb0 0x7fbb400c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fbb4dc66640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbb40039860 0x7fbb40035030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33136/0 (socket says 172.21.15.103:33136) 2024-04-25T10:33:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fbb4dc66640 1 -- 172.21.15.103:0/964530556 learned_addr learned my addr 172.21.15.103:0/964530556 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/964530556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb400c3090 0x7fbb400d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fbb4ec68640 1 -- 172.21.15.103:0/964530556 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb400c90a0 con 0x7fbb40039860 2024-04-25T10:33:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fbb4ec68640 1 -- 172.21.15.103:0/964530556 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbb40039c70 con 0x7fbb40037bb0 2024-04-25T10:33:49.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fbb4ec68640 1 -- 172.21.15.103:0/964530556 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fbb400c9380 con 0x7fbb400c3090 2024-04-25T10:33:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fe74ae80640 1 -- 172.21.15.103:0/1868506485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0c9a10 msgr2=0x7fe73c0c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fe74ae80640 1 --2- 172.21.15.103:0/1868506485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0c9a10 0x7fe73c0c9e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe734009870 tx=0x7fe73402a130 comp rx=0 tx=0).stop 2024-04-25T10:33:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7f066e59c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f067006c7a0 0x7f0670071fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33122/0 (socket says 172.21.15.103:33122) 2024-04-25T10:33:49.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7f89d57da640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d009d360 0x7f89d00b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7f89d57da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d00aff60 0x7f89d013b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fe74ae80640 1 -- 172.21.15.103:0/1868506485 shutdown_connections 2024-04-25T10:33:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fe74ae80640 1 --2- 172.21.15.103:0/1868506485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0c9a10 0x7fe73c0c9e20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fe74ae80640 1 --2- 172.21.15.103:0/1868506485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0383e0 0x7fe73c0387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7fe74ae80640 1 -- 172.21.15.103:0/1868506485 >> 172.21.15.103:0/1868506485 conn(0x7fe73c03f160 msgr2=0x7fe73c03f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.866+0000 7f066e59c640 1 -- 172.21.15.103:0/754409059 learned_addr learned my addr 172.21.15.103:0/754409059 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:49.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7f89d57da640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d014d920 0x7f89d014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7fe74ae80640 1 -- 172.21.15.103:0/1868506485 shutdown_connections 2024-04-25T10:33:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7f89d57da640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f89d006db10 con 0x7f89d014d920 2024-04-25T10:33:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7f89d57da640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f89d0151dd0 con 0x7f89d00aff60 2024-04-25T10:33:49.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7f89d57da640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f89d006dc90 con 0x7f89d009d360 2024-04-25T10:33:49.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7fbb4d465640 1 --2- 172.21.15.103:0/964530556 >> v2:172.21.15.103:3300/0 conn(0x7fbb40037bb0 0x7fbb400c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7fe74ae80640 1 -- 172.21.15.103:0/1868506485 wait complete. 2024-04-25T10:33:49.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7f89d4fd9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d014d920 0x7f89d014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7fbb4e467640 1 --2- 172.21.15.103:0/964530556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb400c3090 0x7fbb400d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378319405 0 0) 0x7f06700737e0 con 0x7f067006c7a0 2024-04-25T10:33:49.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7f89d4fd9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d014d920 0x7f89d014cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48984/0 (socket says 172.21.15.103:48984) 2024-04-25T10:33:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7fbb4d465640 1 -- 172.21.15.103:0/964530556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb400c3090 msgr2=0x7fbb400d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7fbb4d465640 1 --2- 172.21.15.103:0/964530556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb400c3090 0x7fbb400d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7fbb4d465640 1 -- 172.21.15.103:0/964530556 >> v1:172.21.15.103:6789/0 conn(0x7fbb40039860 legacy=0x7fbb40035030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.867+0000 7f89d4fd9640 1 -- 172.21.15.103:0/2573017329 learned_addr learned my addr 172.21.15.103:0/2573017329 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0658003520 con 0x7f067006c7a0 2024-04-25T10:33:49.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3469401449 0 0) 0x7f0658003520 con 0x7f067006c7a0 2024-04-25T10:33:49.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 >> v2:172.21.15.132:3300/0 conn(0x7f0670151720 msgr2=0x7f0670147b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:33:49.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f066d59a640 1 --2- 172.21.15.103:0/754409059 >> v2:172.21.15.132:3300/0 conn(0x7f0670151720 0x7f0670147b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 >> v1:172.21.15.132:6789/0 conn(0x7f0670147780 legacy=0x7f0670151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067006cbb0 con 0x7f067006c7a0 2024-04-25T10:33:49.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f89d4fd9640 1 -- 172.21.15.103:0/2573017329 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d009d360 msgr2=0x7f89d00b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7fbb4cc64640 1 -- 172.21.15.103:0/964530556 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469669737 0 0) 0x7fbb400c90a0 con 0x7fbb40039860 2024-04-25T10:33:49.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7fbb4d465640 1 -- 172.21.15.103:0/964530556 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb400c9660 con 0x7fbb40037bb0 2024-04-25T10:33:49.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f06680019f0 con 0x7f067006c7a0 2024-04-25T10:33:49.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 >> v1:172.21.15.103:6789/0 conn(0x7f067006c7a0 legacy=0x7f0670071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7fbb4d465640 1 --2- 172.21.15.103:0/964530556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40037bb0 0x7fbb400c2b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb440087a0 tx=0x7fbb4402c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3969712d0d657c32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066d59a640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0658003a00 0x7f0658003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f89d4fd9640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d009d360 0x7f89d00b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f89d4fd9640 1 -- 172.21.15.103:0/2573017329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d00aff60 msgr2=0x7f89d013b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f89d4fd9640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d00aff60 0x7f89d013b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066d59a640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0658004800 0x7f0658004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7fe74ae80640 1 Processor -- start 2024-04-25T10:33:49.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066d59a640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06580053f0 0x7f065800bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0670073da0 con 0x7f06580053f0 2024-04-25T10:33:49.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7fe74ae80640 1 -- start start 2024-04-25T10:33:49.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f065800c390 con 0x7f0658004800 2024-04-25T10:33:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7fbb4cc64640 1 -- 172.21.15.103:0/964530556 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4403a070 con 0x7fbb40037bb0 2024-04-25T10:33:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.868+0000 7f89d4fd9640 1 -- 172.21.15.103:0/2573017329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d00b4df0 con 0x7f89d014d920 2024-04-25T10:33:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f065800c590 con 0x7f0658003a00 2024-04-25T10:33:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7fbb4cc64640 1 -- 172.21.15.103:0/964530556 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb44032480 con 0x7fbb40037bb0 2024-04-25T10:33:49.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7fbb4cc64640 1 -- 172.21.15.103:0/964530556 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44032850 con 0x7fbb40037bb0 2024-04-25T10:33:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.869+0000 7f066e59c640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0658003a00 0x7f0658003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f89d4fd9640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d014d920 0x7f89d014cbb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009990 tx=0x7f89c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f066ed9d640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06580053f0 0x7f065800bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f89ccff9640 1 -- 172.21.15.103:0/2573017329 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0037040 con 0x7f89d014d920 2024-04-25T10:33:49.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f89d57da640 1 -- 172.21.15.103:0/2573017329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d00b2f30 con 0x7f89d014d920 2024-04-25T10:33:49.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7fe74ae80640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe73c035b50 0x7fe73c03d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f89d57da640 1 -- 172.21.15.103:0/2573017329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d013aba0 con 0x7f89d014d920 2024-04-25T10:33:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.871+0000 7f89ccff9640 1 -- 172.21.15.103:0/2573017329 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c0042070 con 0x7f89d014d920 2024-04-25T10:33:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.871+0000 7f89ccff9640 1 -- 172.21.15.103:0/2573017329 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c003d440 con 0x7f89d014d920 2024-04-25T10:33:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f066ed9d640 1 -- 172.21.15.103:0/754409059 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0658003a00 msgr2=0x7f0658003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f066ed9d640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0658003a00 0x7f0658003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f066ed9d640 1 -- 172.21.15.103:0/754409059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0658004800 msgr2=0x7f0658004c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:33:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f066ed9d640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0658004800 0x7f0658004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.870+0000 7f066ed9d640 1 -- 172.21.15.103:0/754409059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0658003520 con 0x7f06580053f0 2024-04-25T10:33:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.871+0000 7fe74ae80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0383e0 0x7fe73c16a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe74ae80640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0c9a10 0x7fe73c0d9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe74ae80640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c0ca360 con 0x7fe73c0383e0 2024-04-25T10:33:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe74ae80640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c038d30 con 0x7fe73c035b50 2024-04-25T10:33:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe74ae80640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fe73c036d50 con 0x7fe73c0c9a10 2024-04-25T10:33:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe749e7e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe73c035b50 0x7fe73c03d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7f48fed6c640 1 Processor -- start 2024-04-25T10:33:49.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7f48fed6c640 1 -- start start 2024-04-25T10:33:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fbb4ec68640 1 -- 172.21.15.103:0/964530556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40037bb0 msgr2=0x7fbb400c2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/964530556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40037bb0 0x7fbb400c2b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb440087a0 tx=0x7fbb4402c560 comp rx=0 tx=0).stop 2024-04-25T10:33:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe749e7e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe73c035b50 0x7fe73c03d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:58876/0 (socket says 172.21.15.103:58876) 2024-04-25T10:33:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe749e7e640 1 -- 172.21.15.103:0/2385260292 learned_addr learned my addr 172.21.15.103:0/2385260292 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe74967d640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0383e0 0x7fe73c16a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe74a67f640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0c9a10 0x7fe73c0d9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.871+0000 7f066ed9d640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06580053f0 0x7f065800bab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0664009a30 tx=0x7f0658005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53a33b94b4df945 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.871+0000 7f066ed9d640 1 -- 172.21.15.103:0/754409059 reap_dead start 2024-04-25T10:33:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fbb4ec68640 1 -- 172.21.15.103:0/964530556 shutdown_connections 2024-04-25T10:33:49.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/964530556 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb400c3090 0x7fbb400d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/964530556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40037bb0 0x7fbb400c2b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fbb4ec68640 1 -- 172.21.15.103:0/964530556 >> 172.21.15.103:0/964530556 conn(0x7fbb40006270 msgr2=0x7fbb40006680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe749e7e640 1 -- 172.21.15.103:0/2385260292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0c9a10 msgr2=0x7fe73c0d9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe749e7e640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0c9a10 0x7fe73c0d9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe749e7e640 1 -- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0383e0 msgr2=0x7fe73c16a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe749e7e640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0383e0 0x7fe73c16a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.872+0000 7fe749e7e640 1 -- 172.21.15.103:0/2385260292 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c0c73a0 con 0x7fe73c035b50 2024-04-25T10:33:49.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7f89b67fc640 1 -- 172.21.15.103:0/2573017329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d0076b90 con 0x7f89d014d920 2024-04-25T10:33:49.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7fe749e7e640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe73c035b50 0x7fe73c03d0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c470 tx=0x7fe74000c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06640093d0 con 0x7f06580053f0 2024-04-25T10:33:49.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7fbb4ec68640 1 -- 172.21.15.103:0/964530556 shutdown_connections 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066402ac50 con 0x7f06580053f0 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48fed6c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f80af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48fed6c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f80b13c0 con 0x7f48f8147fa0 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48fed6c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f814db60 con 0x7f48f814e080 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48fed6c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f48f8072160 con 0x7f48f8147b90 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48fd309640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f48f814e080 0x7f48f814e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.103:48056/0 (socket says 172.21.15.103:48056) 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48fd309640 1 -- 172.21.15.103:0/1979988374 learned_addr learned my addr 172.21.15.103:0/1979988374 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48fcb08640 1 --2- 172.21.15.103:0/1979988374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f80af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48f77fe640 1 -- 172.21.15.103:0/1979988374 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029274531 0 0) 0x7f48f814db60 con 0x7f48f814e080 2024-04-25T10:33:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f48f77fe640 1 -- 172.21.15.103:0/1979988374 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e0003520 con 0x7f48f814e080 2024-04-25T10:33:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7fbb4ec68640 1 -- 172.21.15.103:0/964530556 wait complete. 2024-04-25T10:33:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.875+0000 7fbb4ec68640 1 Processor -- start 2024-04-25T10:33:49.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7f066d59a640 1 -- 172.21.15.103:0/754409059 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664032440 con 0x7f06580053f0 2024-04-25T10:33:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7fe73a7fc640 1 -- 172.21.15.103:0/2385260292 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740017070 con 0x7fe73c035b50 2024-04-25T10:33:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c03d5e0 con 0x7fe73c035b50 2024-04-25T10:33:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c0c6cd0 con 0x7fe73c035b50 2024-04-25T10:33:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7fe73a7fc640 1 -- 172.21.15.103:0/2385260292 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7400035f0 con 0x7fe73c035b50 2024-04-25T10:33:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.873+0000 7fe73a7fc640 1 -- 172.21.15.103:0/2385260292 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7400039e0 con 0x7fe73c035b50 2024-04-25T10:33:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.876+0000 7fe73a7fc640 1 -- 172.21.15.103:0/2385260292 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fe74001a070 con 0x7fe73c035b50 2024-04-25T10:33:49.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.875+0000 7f48fcb08640 1 -- 172.21.15.103:0/1979988374 >> v1:172.21.15.132:6789/0 conn(0x7f48f814e080 legacy=0x7f48f814e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.875+0000 7f48fcb08640 1 -- 172.21.15.103:0/1979988374 >> v1:172.21.15.103:6789/0 conn(0x7f48f8147fa0 legacy=0x7f48f80b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.875+0000 7f48fcb08640 1 -- 172.21.15.103:0/1979988374 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f80b10d0 con 0x7f48f8147b90 2024-04-25T10:33:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.874+0000 7f89ccff9640 1 -- 172.21.15.103:0/2573017329 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f89c003d5e0 con 0x7f89d014d920 2024-04-25T10:33:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.875+0000 7f89ccff9640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f89bc0744b0 0x7f89bc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.875+0000 7f89ccff9640 1 -- 172.21.15.103:0/2573017329 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f89c00b5d90 con 0x7f89d014d920 2024-04-25T10:33:49.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.876+0000 7f89cffff640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f89bc0744b0 0x7f89bc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.876+0000 7fe73a7fc640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe728074580 0x7fe728076a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.875+0000 7fbb4ec68640 1 -- start start 2024-04-25T10:33:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4ec68640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb40037bb0 0x7fbb4016a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4ec68640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40039860 0x7fbb400c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fe73a7fc640 1 -- 172.21.15.103:0/2385260292 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe7400944d0 con 0x7fe73c035b50 2024-04-25T10:33:49.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fe74967d640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe728074580 0x7fe728076a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7f48fcb08640 1 --2- 172.21.15.103:0/1979988374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f80af8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f48e80097d0 tx=0x7f48e802a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e07b72b20fe056 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4ec68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb400c3090 0x7fbb400cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4ec68640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbb400c9b80 con 0x7fbb40039860 2024-04-25T10:33:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4ec68640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbb40035740 con 0x7fbb400c3090 2024-04-25T10:33:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4ec68640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fbb40037fc0 con 0x7fbb40037bb0 2024-04-25T10:33:49.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4d465640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40039860 0x7fbb400c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4dc66640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb40037bb0 0x7fbb4016a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4dc66640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb40037bb0 0x7fbb4016a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:46196/0 (socket says 172.21.15.103:46196) 2024-04-25T10:33:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4dc66640 1 -- 172.21.15.103:0/3817644426 learned_addr learned my addr 172.21.15.103:0/3817644426 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7f0674c84640 1 -- 172.21.15.103:0/754409059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06580053f0 msgr2=0x7f065800bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7f0674c84640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06580053f0 0x7f065800bab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0664009a30 tx=0x7f0658005830 comp rx=0 tx=0).stop 2024-04-25T10:33:49.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fbb4e467640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb400c3090 0x7fbb400cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.877+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72c005290 con 0x7fe73c035b50 2024-04-25T10:33:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7f48f77fe640 1 -- 172.21.15.103:0/1979988374 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8037070 con 0x7f48f8147b90 2024-04-25T10:33:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7f48f77fe640 1 -- 172.21.15.103:0/1979988374 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e802ae40 con 0x7f48f8147b90 2024-04-25T10:33:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb4dc66640 1 -- 172.21.15.103:0/3817644426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb400c3090 msgr2=0x7fbb400cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb4dc66640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb400c3090 0x7fbb400cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb4dc66640 1 -- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40039860 msgr2=0x7fbb400c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb4dc66640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40039860 0x7fbb400c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb4dc66640 1 -- 172.21.15.103:0/3817644426 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb400ca330 con 0x7fbb40037bb0 2024-04-25T10:33:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7f0674c84640 1 -- 172.21.15.103:0/754409059 shutdown_connections 2024-04-25T10:33:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7f0674c84640 1 --2- 172.21.15.103:0/754409059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06580053f0 0x7f065800bab0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7f0674c84640 1 -- 172.21.15.103:0/754409059 >> 172.21.15.103:0/754409059 conn(0x7f06700b80d0 msgr2=0x7f067006ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:49.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb4dc66640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb40037bb0 0x7fbb4016a5a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c3c0 tx=0x7fbb3800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7f0674c84640 1 -- 172.21.15.103:0/754409059 shutdown_connections 2024-04-25T10:33:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7f0674c84640 1 -- 172.21.15.103:0/754409059 wait complete. 2024-04-25T10:33:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7f89cffff640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f89bc0744b0 0x7f89bc0769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89c4006e80 tx=0x7f89c4006dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb3e7fc640 1 -- 172.21.15.103:0/3817644426 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb380074e0 con 0x7fbb40037bb0 2024-04-25T10:33:49.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb3e7fc640 1 -- 172.21.15.103:0/3817644426 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb380047e0 con 0x7fbb40037bb0 2024-04-25T10:33:49.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fe74967d640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe728074580 0x7fe728076a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe74402e0e0 tx=0x7fe74408e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.878+0000 7fbb3e7fc640 1 -- 172.21.15.103:0/3817644426 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb38004bd0 con 0x7fbb40037bb0 2024-04-25T10:33:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7f48fed6c640 1 -- 172.21.15.103:0/1979988374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 msgr2=0x7f48f80af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7f48fed6c640 1 --2- 172.21.15.103:0/1979988374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f80af8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f48e80097d0 tx=0x7f48e802a0f0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7f48fed6c640 1 -- 172.21.15.103:0/1979988374 shutdown_connections 2024-04-25T10:33:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7f48fed6c640 1 --2- 172.21.15.103:0/1979988374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f80af8f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7f48fed6c640 1 -- 172.21.15.103:0/1979988374 >> 172.21.15.103:0/1979988374 conn(0x7f48f80b77a0 msgr2=0x7f48f80ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb400bd710 con 0x7fbb40037bb0 2024-04-25T10:33:49.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb400cbe30 con 0x7fbb40037bb0 2024-04-25T10:33:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7f48fed6c640 1 -- 172.21.15.103:0/1979988374 shutdown_connections 2024-04-25T10:33:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.879+0000 7f48fed6c640 1 -- 172.21.15.103:0/1979988374 wait complete. 2024-04-25T10:33:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.880+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4016aae0 con 0x7fbb40037bb0 2024-04-25T10:33:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.881+0000 7f0674c84640 1 Processor -- start 2024-04-25T10:33:49.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.881+0000 7fbb3e7fc640 1 -- 172.21.15.103:0/3817644426 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbb38011070 con 0x7fbb40037bb0 2024-04-25T10:33:49.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.881+0000 7f0674c84640 1 -- start start 2024-04-25T10:33:49.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7f48fed6c640 1 Processor -- start 2024-04-25T10:33:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7fbb3e7fc640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb2c074530 0x7fbb2c076a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7fbb3e7fc640 1 -- 172.21.15.103:0/3817644426 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbb38094c20 con 0x7fbb40037bb0 2024-04-25T10:33:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7f0674c84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0670148a80 0x7f0670149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7fbb4d465640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb2c074530 0x7fbb2c076a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7f0674c84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0670145dd0 0x7f06701461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7f0674c84640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06701e6940 0x7f06701e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7f0674c84640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0670147f20 con 0x7f06701e6940 2024-04-25T10:33:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7f0674c84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0670147da0 con 0x7f0670145dd0 2024-04-25T10:33:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f0674c84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f0670151010 con 0x7f0670148a80 2024-04-25T10:33:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f066ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06701e6940 0x7f06701e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7fe73a7fc640 1 -- 172.21.15.103:0/2385260292 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe74005e680 con 0x7fe73c035b50 2024-04-25T10:33:49.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f066ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06701e6940 0x7f06701e6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49022/0 (socket says 172.21.15.103:49022) 2024-04-25T10:33:49.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f066ed9d640 1 -- 172.21.15.103:0/579128342 learned_addr learned my addr 172.21.15.103:0/579128342 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7fbb4d465640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb2c074530 0x7fbb2c076a40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbb44037000 tx=0x7fbb44030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f066ed9d640 1 -- 172.21.15.103:0/579128342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0670148a80 msgr2=0x7f0670149190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:33:49.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f066ed9d640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0670148a80 0x7f0670149190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f066ed9d640 1 -- 172.21.15.103:0/579128342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0670145dd0 msgr2=0x7f06701461e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:33:49.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f066ed9d640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0670145dd0 0x7f06701461e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.883+0000 7f066ed9d640 1 -- 172.21.15.103:0/579128342 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06701496d0 con 0x7f06701e6940 2024-04-25T10:33:49.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.882+0000 7f48fed6c640 1 -- start start 2024-04-25T10:33:49.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f066ed9d640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06701e6940 0x7f06701e6d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0664009b20 tx=0x7f0664004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fed6c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f8145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fed6c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f814e080 0x7f48f81e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fcb08640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f8145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fcb08640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f8145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:46204/0 (socket says 172.21.15.103:46204) 2024-04-25T10:33:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fcb08640 1 -- 172.21.15.103:0/4272317145 learned_addr learned my addr 172.21.15.103:0/4272317145 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fed6c640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f8146510 0x7f48f81435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48f80affb0 con 0x7f48f8146510 2024-04-25T10:33:49.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f48f80afe30 con 0x7f48f814e080 2024-04-25T10:33:49.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48f7fff640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f814e080 0x7f48f81e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fd309640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f8146510 0x7f48f81435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.884+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f48f8159320 con 0x7f48f8147b90 2024-04-25T10:33:49.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.885+0000 7f48fcb08640 1 -- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f814e080 msgr2=0x7f48f81e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.885+0000 7f48fcb08640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f814e080 0x7f48f81e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.885+0000 7f89ccff9640 1 -- 172.21.15.103:0/2573017329 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f89c0080510 con 0x7f89d014d920 2024-04-25T10:33:49.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.885+0000 7f48fcb08640 1 -- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f8146510 msgr2=0x7f48f81435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:49.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.885+0000 7f48fcb08640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f8146510 0x7f48f81435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:49.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.885+0000 7f48fcb08640 1 -- 172.21.15.103:0/4272317145 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f81e35d0 con 0x7f48f8147b90 2024-04-25T10:33:49.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.885+0000 7f48f7fff640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f814e080 0x7f48f81e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:49.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.886+0000 7f065effd640 1 -- 172.21.15.103:0/579128342 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664045070 con 0x7f06701e6940 2024-04-25T10:33:49.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.886+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067014a500 con 0x7f06701e6940 2024-04-25T10:33:49.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.885+0000 7f48fcb08640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f8145010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f48e802a6e0 tx=0x7f48e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.886+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067014aac0 con 0x7f06701e6940 2024-04-25T10:33:49.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.886+0000 7f065effd640 1 -- 172.21.15.103:0/579128342 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066402aa50 con 0x7f06701e6940 2024-04-25T10:33:49.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.886+0000 7f065effd640 1 -- 172.21.15.103:0/579128342 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0664045070 con 0x7f06701e6940 2024-04-25T10:33:49.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.887+0000 7fbb3e7fc640 1 -- 172.21.15.103:0/3817644426 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbb4016aae0 con 0x7fbb40037bb0 2024-04-25T10:33:49.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.889+0000 7f48f57fa640 1 -- 172.21.15.103:0/4272317145 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8041020 con 0x7f48f8147b90 2024-04-25T10:33:49.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.889+0000 7f48f57fa640 1 -- 172.21.15.103:0/4272317145 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e80308f0 con 0x7f48f8147b90 2024-04-25T10:33:49.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.889+0000 7f48f57fa640 1 -- 172.21.15.103:0/4272317145 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8037040 con 0x7f48f8147b90 2024-04-25T10:33:49.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.891+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f81e3870 con 0x7f48f8147b90 2024-04-25T10:33:49.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.892+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f8146920 con 0x7f48f8147b90 2024-04-25T10:33:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.889+0000 7f065effd640 1 -- 172.21.15.103:0/579128342 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f0664048070 con 0x7f06701e6940 2024-04-25T10:33:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.890+0000 7f065effd640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06500748b0 0x7f0650076dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.890+0000 7f066e59c640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06500748b0 0x7f0650076dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.890+0000 7f065effd640 1 -- 172.21.15.103:0/579128342 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0664039040 con 0x7f06701e6940 2024-04-25T10:33:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.890+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0654005290 con 0x7f06701e6940 2024-04-25T10:33:49.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.891+0000 7f066e59c640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06500748b0 0x7f0650076dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0668004bf0 tx=0x7f0668004b60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.899+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f806a130 con 0x7f48f8147b90 2024-04-25T10:33:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.900+0000 7f48f57fa640 1 -- 172.21.15.103:0/4272317145 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f48e8044020 con 0x7f48f8147b90 2024-04-25T10:33:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.901+0000 7f48f57fa640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f48e40744b0 0x7f48e40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.901+0000 7f48f57fa640 1 -- 172.21.15.103:0/4272317145 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f48e80b5410 con 0x7f48f8147b90 2024-04-25T10:33:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.901+0000 7f48f7fff640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f48e40744b0 0x7f48e40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:49.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.903+0000 7f48f7fff640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f48e40744b0 0x7f48e40769c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f48f00012e0 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.901+0000 7f065effd640 1 -- 172.21.15.103:0/579128342 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f066407e8d0 con 0x7f06701e6940 2024-04-25T10:33:49.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:49.907+0000 7f48f57fa640 1 -- 172.21.15.103:0/4272317145 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f48e807f5d0 con 0x7f48f8147b90 2024-04-25T10:33:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.171+0000 7f8f4359e640 1 -- 172.21.15.103:0/2772854823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8f3c0c9220 con 0x7f8f3c0cbc30 2024-04-25T10:33:50.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.172+0000 7f8f32ffd640 1 -- 172.21.15.103:0/2772854823 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f44100ae0 con 0x7f8f3c0cbc30 2024-04-25T10:33:50.174 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.175+0000 7f8f30ff9640 1 -- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8f240745b0 msgr2=0x7f8f24076ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8f240745b0 0x7f8f24076ac0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0294c0 tx=0x7f8f38009060 comp rx=0 tx=0).stop 2024-04-25T10:33:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 -- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cbc30 msgr2=0x7f8f3c0d9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cbc30 0x7f8f3c0d9fa0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8f44076fa0 tx=0x7f8f4406a640 comp rx=0 tx=0).stop 2024-04-25T10:33:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 -- 172.21.15.103:0/2772854823 shutdown_connections 2024-04-25T10:33:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8f240745b0 0x7f8f24076ac0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f3c0cbc30 0x7f8f3c0d9fa0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f3c039db0 0x7f8f3c0d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 --2- 172.21.15.103:0/2772854823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8f3c031fa0 0x7f8f3c0cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.176+0000 7f8f30ff9640 1 -- 172.21.15.103:0/2772854823 >> 172.21.15.103:0/2772854823 conn(0x7f8f3c03b7b0 msgr2=0x7f8f3c006c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.177+0000 7f8f30ff9640 1 -- 172.21.15.103:0/2772854823 shutdown_connections 2024-04-25T10:33:50.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.177+0000 7f8f30ff9640 1 -- 172.21.15.103:0/2772854823 wait complete. 2024-04-25T10:33:50.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-25T10:33:50.195 DEBUG:teuthology.parallel:result is None 2024-04-25T10:33:50.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.230+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbb8c005850 con 0x7fbbac1495f0 2024-04-25T10:33:50.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.231+0000 7fbba1ffb640 1 -- 172.21.15.103:0/3264691973 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbba405ee60 con 0x7fbbac1495f0 2024-04-25T10:33:50.232 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:50.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb90074580 msgr2=0x7fbb90076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb90074580 0x7fbb90076a90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbac0b4c50 tx=0x7fbb9c008040 comp rx=0 tx=0).stop 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbac1495f0 msgr2=0x7fbbac149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbac1495f0 0x7fbbac149a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbba400c770 tx=0x7fbba400cc30 comp rx=0 tx=0).stop 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 shutdown_connections 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb90074580 0x7fbb90076a90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbac1495f0 0x7fbbac149a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbac09bf00 0x7fbbac0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 --2- 172.21.15.103:0/3264691973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbbac147b90 0x7fbbac0b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 >> 172.21.15.103:0/3264691973 conn(0x7fbbac0b77a0 msgr2=0x7fbbac0b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 shutdown_connections 2024-04-25T10:33:50.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.234+0000 7fbbb39c0640 1 -- 172.21.15.103:0/3264691973 wait complete. 2024-04-25T10:33:50.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.235+0000 7f950a7fc640 1 -- 172.21.15.103:0/3546693716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f95240b7880 con 0x7f952408c060 2024-04-25T10:33:50.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.236+0000 7f9520ff9640 1 -- 172.21.15.103:0/3546693716 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f95240b3be0 con 0x7f952408c060 2024-04-25T10:33:50.238 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:50.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 -- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9510074530 msgr2=0x7f9510076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9510074530 0x7f9510076a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f950c0057e0 tx=0x7f9518030000 comp rx=0 tx=0).stop 2024-04-25T10:33:50.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 -- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f952408c060 msgr2=0x7f95241d7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f952408c060 0x7f95241d7180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95140039b0 tx=0x7f9514003e70 comp rx=0 tx=0).stop 2024-04-25T10:33:50.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 -- 172.21.15.103:0/3546693716 shutdown_connections 2024-04-25T10:33:50.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9510074530 0x7f9510076a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f952413eb10 0x7f952413ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f952408c060 0x7f95241d7180 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 --2- 172.21.15.103:0/3546693716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f950c0039b0 0x7f95241d9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 -- 172.21.15.103:0/3546693716 >> 172.21.15.103:0/3546693716 conn(0x7f95240b80d0 msgr2=0x7f952414b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 -- 172.21.15.103:0/3546693716 shutdown_connections 2024-04-25T10:33:50.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.239+0000 7f950a7fc640 1 -- 172.21.15.103:0/3546693716 wait complete. 2024-04-25T10:33:50.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.250+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbb40005570 con 0x7fbb40037bb0 2024-04-25T10:33:50.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.251+0000 7fbb3e7fc640 1 -- 172.21.15.103:0/3817644426 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb38067390 con 0x7fbb40037bb0 2024-04-25T10:33:50.252 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:50.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-04-25T10:33:50.254 DEBUG:teuthology.parallel:result is None 2024-04-25T10:33:50.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb2c074530 msgr2=0x7fbb2c076a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb2c074530 0x7fbb2c076a40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbb44037000 tx=0x7fbb44030000 comp rx=0 tx=0).stop 2024-04-25T10:33:50.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb40037bb0 msgr2=0x7fbb4016a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb40037bb0 0x7fbb4016a5a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb3800c3c0 tx=0x7fbb3800c880 comp rx=0 tx=0).stop 2024-04-25T10:33:50.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 shutdown_connections 2024-04-25T10:33:50.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbb2c074530 0x7fbb2c076a40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb400c3090 0x7fbb400cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb40039860 0x7fbb400c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 --2- 172.21.15.103:0/3817644426 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbb40037bb0 0x7fbb4016a5a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.253+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 >> 172.21.15.103:0/3817644426 conn(0x7fbb40006270 msgr2=0x7fbb40036600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.255+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 shutdown_connections 2024-04-25T10:33:50.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.256+0000 7fbb4ec68640 1 -- 172.21.15.103:0/3817644426 wait complete. 2024-04-25T10:33:50.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-25T10:33:50.258 DEBUG:teuthology.parallel:result is None 2024-04-25T10:33:50.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-25T10:33:50.273 DEBUG:teuthology.parallel:result is None 2024-04-25T10:33:50.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.280+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f48f80a0810 con 0x7f48f8147b90 2024-04-25T10:33:50.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.280+0000 7f48f57fa640 1 -- 172.21.15.103:0/4272317145 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f48e80838d0 con 0x7f48f8147b90 2024-04-25T10:33:50.282 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f48e40744b0 msgr2=0x7f48e40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f48e40744b0 0x7f48e40769c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f48f00012e0 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2024-04-25T10:33:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 msgr2=0x7f48f8145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f8145010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f48e802a6e0 tx=0x7f48e80046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f89b67fc640 1 -- 172.21.15.103:0/2573017329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f89d00b2750 con 0x7f89d014d920 2024-04-25T10:33:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 shutdown_connections 2024-04-25T10:33:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f48e40744b0 0x7f48e40769c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48f8146510 0x7f48f81435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48f814e080 0x7f48f81e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 --2- 172.21.15.103:0/4272317145 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48f8147b90 0x7f48f8145010 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 >> 172.21.15.103:0/4272317145 conn(0x7f48f80b77a0 msgr2=0x7f48f8072680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 shutdown_connections 2024-04-25T10:33:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f48fed6c640 1 -- 172.21.15.103:0/4272317145 wait complete. 2024-04-25T10:33:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.283+0000 7f89ccff9640 1 -- 172.21.15.103:0/2573017329 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f89c007fe10 con 0x7f89d014d920 2024-04-25T10:33:50.287 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 -- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f89bc0744b0 msgr2=0x7f89bc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f89bc0744b0 0x7f89bc0769c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89c4006e80 tx=0x7f89c4006dd0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 -- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d014d920 msgr2=0x7f89d014cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d014d920 0x7f89d014cbb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009990 tx=0x7f89c00046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 -- 172.21.15.103:0/2573017329 shutdown_connections 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f89bc0744b0 0x7f89bc0769c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d014d920 0x7f89d014cbb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89d00aff60 0x7f89d013b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 --2- 172.21.15.103:0/2573017329 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f89d009d360 0x7f89d00b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 -- 172.21.15.103:0/2573017329 >> 172.21.15.103:0/2573017329 conn(0x7f89d006f180 msgr2=0x7f89d00b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 -- 172.21.15.103:0/2573017329 shutdown_connections 2024-04-25T10:33:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.285+0000 7f89b67fc640 1 -- 172.21.15.103:0/2573017329 wait complete. 2024-04-25T10:33:50.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-25T10:33:50.296 DEBUG:teuthology.parallel:result is None 2024-04-25T10:33:50.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-04-25T10:33:50.298 DEBUG:teuthology.parallel:result is None 2024-04-25T10:33:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.302+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe72c005580 con 0x7fe73c035b50 2024-04-25T10:33:50.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.303+0000 7fe73a7fc640 1 -- 172.21.15.103:0/2385260292 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe740062980 con 0x7fe73c035b50 2024-04-25T10:33:50.304 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.305+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe728074580 msgr2=0x7fe728076a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.305+0000 7fe74ae80640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe728074580 0x7fe728076a90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe74402e0e0 tx=0x7fe74408e040 comp rx=0 tx=0).stop 2024-04-25T10:33:50.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.305+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe73c035b50 msgr2=0x7fe73c03d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.305+0000 7fe74ae80640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe73c035b50 0x7fe73c03d0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c470 tx=0x7fe74000c930 comp rx=0 tx=0).stop 2024-04-25T10:33:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.306+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 shutdown_connections 2024-04-25T10:33:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.306+0000 7fe74ae80640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fe728074580 0x7fe728076a90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.306+0000 7fe74ae80640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe73c0c9a10 0x7fe73c0d9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.306+0000 7fe74ae80640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe73c0383e0 0x7fe73c16a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.306+0000 7fe74ae80640 1 --2- 172.21.15.103:0/2385260292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe73c035b50 0x7fe73c03d0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.306+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 >> 172.21.15.103:0/2385260292 conn(0x7fe73c03f160 msgr2=0x7fe73c03bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.306+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 shutdown_connections 2024-04-25T10:33:50.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.306+0000 7fe74ae80640 1 -- 172.21.15.103:0/2385260292 wait complete. 2024-04-25T10:33:50.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-25T10:33:50.322 DEBUG:teuthology.parallel:result is None 2024-04-25T10:33:50.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.322+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0654005850 con 0x7f06701e6940 2024-04-25T10:33:50.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.322+0000 7f065effd640 1 -- 172.21.15.103:0/579128342 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06640875f0 con 0x7f06701e6940 2024-04-25T10:33:50.324 INFO:teuthology.orchestra.run.smithi103.stdout:55834574855 2024-04-25T10:33:50.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06500748b0 msgr2=0x7f0650076dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06500748b0 0x7f0650076dc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0668004bf0 tx=0x7f0668004b60 comp rx=0 tx=0).stop 2024-04-25T10:33:50.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06701e6940 msgr2=0x7f06701e6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06701e6940 0x7f06701e6d50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0664009b20 tx=0x7f0664004700 comp rx=0 tx=0).stop 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 shutdown_connections 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f06500748b0 0x7f0650076dc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06701e6940 0x7f06701e6d50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0670145dd0 0x7f06701461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 --2- 172.21.15.103:0/579128342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0670148a80 0x7f0670149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 >> 172.21.15.103:0/579128342 conn(0x7f06700b80d0 msgr2=0x7f067014cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 shutdown_connections 2024-04-25T10:33:50.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.324+0000 7f0674c84640 1 -- 172.21.15.103:0/579128342 wait complete. 2024-04-25T10:33:50.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-25T10:33:50.337 DEBUG:teuthology.parallel:result is None 2024-04-25T10:33:50.337 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T10:33:50.337 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:33:50.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.483+0000 7fa8eff96640 1 Processor -- start 2024-04-25T10:33:50.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.483+0000 7fa8eff96640 1 -- start start 2024-04-25T10:33:50.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8eff96640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8e80b7f50 0x7fa8e8072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8eff96640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e814d920 con 0x7fa8e8149a10 2024-04-25T10:33:50.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8eff96640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e8073330 con 0x7fa8e8070330 2024-04-25T10:33:50.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8eff96640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e814caa0 con 0x7fa8e80b7f50 2024-04-25T10:33:50.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8edd32640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8e80b7f50 0x7fa8e8072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8ee533640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa8e8149a10 0x7fa8e8149e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33152/0 (socket says 172.21.15.103:33152) 2024-04-25T10:33:50.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8ee533640 1 -- 172.21.15.103:0/3055396352 learned_addr learned my addr 172.21.15.103:0/3055396352 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:50.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8edd32640 1 -- 172.21.15.103:0/3055396352 >> v1:172.21.15.132:6789/0 conn(0x7fa8e8070330 legacy=0x7fa8e814d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8edd32640 1 -- 172.21.15.103:0/3055396352 >> v1:172.21.15.103:6789/0 conn(0x7fa8e8149a10 legacy=0x7fa8e8149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8edd32640 1 -- 172.21.15.103:0/3055396352 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e814ccf0 con 0x7fa8e80b7f50 2024-04-25T10:33:50.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.484+0000 7fa8ecd30640 1 -- 172.21.15.103:0/3055396352 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584212060 0 0) 0x7fa8e814d920 con 0x7fa8e8149a10 2024-04-25T10:33:50.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.485+0000 7fa8edd32640 1 --2- 172.21.15.103:0/3055396352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8072d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40097a0 tx=0x7fa8e402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160a61f9af239887 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:50.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.485+0000 7fa8ecd30640 1 -- 172.21.15.103:0/3055396352 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4037070 con 0x7fa8e80b7f50 2024-04-25T10:33:50.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.485+0000 7fa8ecd30640 1 -- 172.21.15.103:0/3055396352 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4032440 con 0x7fa8e80b7f50 2024-04-25T10:33:50.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.485+0000 7fa8ecd30640 1 -- 172.21.15.103:0/3055396352 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4032810 con 0x7fa8e80b7f50 2024-04-25T10:33:50.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.486+0000 7fa8eff96640 1 -- 172.21.15.103:0/3055396352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 msgr2=0x7fa8e8072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.486+0000 7fa8eff96640 1 --2- 172.21.15.103:0/3055396352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8072d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40097a0 tx=0x7fa8e402a230 comp rx=0 tx=0).stop 2024-04-25T10:33:50.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.486+0000 7fa8eff96640 1 -- 172.21.15.103:0/3055396352 shutdown_connections 2024-04-25T10:33:50.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.486+0000 7fa8eff96640 1 --2- 172.21.15.103:0/3055396352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8072d50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.486+0000 7fa8eff96640 1 -- 172.21.15.103:0/3055396352 >> 172.21.15.103:0/3055396352 conn(0x7fa8e806f630 msgr2=0x7fa8e806fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.486+0000 7fa8eff96640 1 -- 172.21.15.103:0/3055396352 shutdown_connections 2024-04-25T10:33:50.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.486+0000 7fa8eff96640 1 -- 172.21.15.103:0/3055396352 wait complete. 2024-04-25T10:33:50.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.487+0000 7fa8eff96640 1 Processor -- start 2024-04-25T10:33:50.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.488+0000 7fa8eff96640 1 -- start start 2024-04-25T10:33:50.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.488+0000 7fa8eff96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e8070330 0x7fa8e813c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8eff96640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8eff96640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8e8149a10 0x7fa8e8137f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8eff96640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e81494b0 con 0x7fa8e80b7f50 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8eff96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8073fe0 con 0x7fa8e8070330 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8eff96640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e8149630 con 0x7fa8e8149a10 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8137a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49058/0 (socket says 172.21.15.103:49058) 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 -- 172.21.15.103:0/972503485 learned_addr learned my addr 172.21.15.103:0/972503485 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 -- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8e8149a10 msgr2=0x7fa8e8137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8edd32640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e8070330 0x7fa8e813c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ee533640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8e8149a10 0x7fa8e8137f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8e8149a10 0x7fa8e8137f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 -- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e8070330 msgr2=0x7fa8e813c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e8070330 0x7fa8e813c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 -- 172.21.15.103:0/972503485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e8145c00 con 0x7fa8e80b7f50 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8edd32640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e8070330 0x7fa8e813c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ee533640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8e8149a10 0x7fa8e8137f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8ed531640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8137a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800c430 tx=0x7fa8d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8de7fc640 1 -- 172.21.15.103:0/972503485 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8017070 con 0x7fa8e80b7f50 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8de7fc640 1 -- 172.21.15.103:0/972503485 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d80052d0 con 0x7fa8e80b7f50 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e81384b0 con 0x7fa8e80b7f50 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8de7fc640 1 -- 172.21.15.103:0/972503485 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8003830 con 0x7fa8e80b7f50 2024-04-25T10:33:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.489+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e81461c0 con 0x7fa8e80b7f50 2024-04-25T10:33:50.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.491+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e80b26e0 con 0x7fa8e80b7f50 2024-04-25T10:33:50.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.491+0000 7fa8de7fc640 1 -- 172.21.15.103:0/972503485 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa8d801a070 con 0x7fa8e80b7f50 2024-04-25T10:33:50.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.491+0000 7fa8de7fc640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8cc0744b0 0x7fa8cc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.491+0000 7fa8edd32640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8cc0744b0 0x7fa8cc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.491+0000 7fa8de7fc640 1 -- 172.21.15.103:0/972503485 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa8d8094580 con 0x7fa8e80b7f50 2024-04-25T10:33:50.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.492+0000 7fa8edd32640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8cc0744b0 0x7fa8cc0769c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4034000 tx=0x7fa8e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:50.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.496+0000 7fa8de7fc640 1 -- 172.21.15.103:0/972503485 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8d805ed10 con 0x7fa8e80b7f50 2024-04-25T10:33:50.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.667+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8e80a04b0 con 0x7fa8cc0744b0 2024-04-25T10:33:50.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.673+0000 7fa8de7fc640 1 -- 172.21.15.103:0/972503485 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251861 (secure 0 0 0) 0x7fa8e80a04b0 con 0x7fa8cc0744b0 2024-04-25T10:33:50.677 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:50.679 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:33:50.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8cc0744b0 msgr2=0x7fa8cc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8cc0744b0 0x7fa8cc0769c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4034000 tx=0x7fa8e402e000 comp rx=0 tx=0).stop 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 msgr2=0x7fa8e8137a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8137a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800c430 tx=0x7fa8d800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 shutdown_connections 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa8cc0744b0 0x7fa8cc0769c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8e8149a10 0x7fa8e8137f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8e80b7f50 0x7fa8e8137a30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 --2- 172.21.15.103:0/972503485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e8070330 0x7fa8e813c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 >> 172.21.15.103:0/972503485 conn(0x7fa8e806f630 msgr2=0x7fa8e8075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 shutdown_connections 2024-04-25T10:33:50.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.676+0000 7fa8eff96640 1 -- 172.21.15.103:0/972503485 wait complete. 2024-04-25T10:33:50.689 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T10:33:50.492734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.565060+0000","last_change":"2024-04-25T10:33:43.181183+0000","last_active":"2024-04-25T10:33:45.565060+0000","last_peered":"2024-04-25T10:33:45.565060+0000","last_clean":"2024-04-25T10:33:45.565060+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:33:45.565060+0000","last_undegraded":"2024-04-25T10:33:45.565060+0000","last_fullsized":"2024-04-25T10:33:45.565060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:44.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065236+0000","last_change":"2024-04-25T10:33:43.170436+0000","last_active":"2024-04-25T10:33:45.065236+0000","last_peered":"2024-04-25T10:33:45.065236+0000","last_clean":"2024-04-25T10:33:45.065236+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:33:45.065236+0000","last_undegraded":"2024-04-25T10:33:45.065236+0000","last_fullsized":"2024-04-25T10:33:45.065236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167080+0000","last_change":"2024-04-25T10:33:43.181271+0000","last_active":"2024-04-25T10:33:44.167080+0000","last_peered":"2024-04-25T10:33:44.167080+0000","last_clean":"2024-04-25T10:33:44.167080+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:33:44.167080+0000","last_undegraded":"2024-04-25T10:33:44.167080+0000","last_fullsized":"2024-04-25T10:33:44.167080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563903+0000","last_change":"2024-04-25T10:33:43.176831+0000","last_active":"2024-04-25T10:33:45.563903+0000","last_peered":"2024-04-25T10:33:45.563903+0000","last_clean":"2024-04-25T10:33:45.563903+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:33:45.563903+0000","last_undegraded":"2024-04-25T10:33:45.563903+0000","last_fullsized":"2024-04-25T10:33:45.563903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564659+0000","last_change":"2024-04-25T10:33:43.181222+0000","last_active":"2024-04-25T10:33:45.564659+0000","last_peered":"2024-04-25T10:33:45.564659+0000","last_clean":"2024-04-25T10:33:45.564659+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:33:45.564659+0000","last_undegraded":"2024-04-25T10:33:45.564659+0000","last_fullsized":"2024-04-25T10:33:45.564659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:42.544249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564587+0000","last_change":"2024-04-25T10:33:43.175444+0000","last_active":"2024-04-25T10:33:45.564587+0000","last_peered":"2024-04-25T10:33:45.564587+0000","last_clean":"2024-04-25T10:33:45.564587+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:33:45.564587+0000","last_undegraded":"2024-04-25T10:33:45.564587+0000","last_fullsized":"2024-04-25T10:33:45.564587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564240+0000","last_change":"2024-04-25T10:33:43.186303+0000","last_active":"2024-04-25T10:33:45.564240+0000","last_peered":"2024-04-25T10:33:45.564240+0000","last_clean":"2024-04-25T10:33:45.564240+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:33:45.564240+0000","last_undegraded":"2024-04-25T10:33:45.564240+0000","last_fullsized":"2024-04-25T10:33:45.564240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167768+0000","last_change":"2024-04-25T10:33:43.169919+0000","last_active":"2024-04-25T10:33:44.167768+0000","last_peered":"2024-04-25T10:33:44.167768+0000","last_clean":"2024-04-25T10:33:44.167768+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:33:44.167768+0000","last_undegraded":"2024-04-25T10:33:44.167768+0000","last_fullsized":"2024-04-25T10:33:44.167768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.565074+0000","last_change":"2024-04-25T10:33:43.183760+0000","last_active":"2024-04-25T10:33:45.565074+0000","last_peered":"2024-04-25T10:33:45.565074+0000","last_clean":"2024-04-25T10:33:45.565074+0000","last_became_active":"2024-04-25T10:33:43.183460+0000","last_became_peered":"2024-04-25T10:33:43.183460+0000","last_unstale":"2024-04-25T10:33:45.565074+0000","last_undegraded":"2024-04-25T10:33:45.565074+0000","last_fullsized":"2024-04-25T10:33:45.565074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:06.866677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063510+0000","last_change":"2024-04-25T10:33:43.175552+0000","last_active":"2024-04-25T10:33:45.063510+0000","last_peered":"2024-04-25T10:33:45.063510+0000","last_clean":"2024-04-25T10:33:45.063510+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:33:45.063510+0000","last_undegraded":"2024-04-25T10:33:45.063510+0000","last_fullsized":"2024-04-25T10:33:45.063510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063291+0000","last_change":"2024-04-25T10:33:43.175526+0000","last_active":"2024-04-25T10:33:45.063291+0000","last_peered":"2024-04-25T10:33:45.063291+0000","last_clean":"2024-04-25T10:33:45.063291+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:33:45.063291+0000","last_undegraded":"2024-04-25T10:33:45.063291+0000","last_fullsized":"2024-04-25T10:33:45.063291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168832+0000","last_change":"2024-04-25T10:33:43.176506+0000","last_active":"2024-04-25T10:33:44.168832+0000","last_peered":"2024-04-25T10:33:44.168832+0000","last_clean":"2024-04-25T10:33:44.168832+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:33:44.168832+0000","last_undegraded":"2024-04-25T10:33:44.168832+0000","last_fullsized":"2024-04-25T10:33:44.168832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:54.213946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168167+0000","last_change":"2024-04-25T10:33:43.178091+0000","last_active":"2024-04-25T10:33:44.168167+0000","last_peered":"2024-04-25T10:33:44.168167+0000","last_clean":"2024-04-25T10:33:44.168167+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:33:44.168167+0000","last_undegraded":"2024-04-25T10:33:44.168167+0000","last_fullsized":"2024-04-25T10:33:44.168167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166881+0000","last_change":"2024-04-25T10:33:43.173440+0000","last_active":"2024-04-25T10:33:44.166881+0000","last_peered":"2024-04-25T10:33:44.166881+0000","last_clean":"2024-04-25T10:33:44.166881+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:33:44.166881+0000","last_undegraded":"2024-04-25T10:33:44.166881+0000","last_fullsized":"2024-04-25T10:33:44.166881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.607252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064963+0000","last_change":"2024-04-25T10:33:43.172566+0000","last_active":"2024-04-25T10:33:45.064963+0000","last_peered":"2024-04-25T10:33:45.064963+0000","last_clean":"2024-04-25T10:33:45.064963+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:33:45.064963+0000","last_undegraded":"2024-04-25T10:33:45.064963+0000","last_fullsized":"2024-04-25T10:33:45.064963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563605+0000","last_change":"2024-04-25T10:33:43.175162+0000","last_active":"2024-04-25T10:33:45.563605+0000","last_peered":"2024-04-25T10:33:45.563605+0000","last_clean":"2024-04-25T10:33:45.563605+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:33:45.563605+0000","last_undegraded":"2024-04-25T10:33:45.563605+0000","last_fullsized":"2024-04-25T10:33:45.563605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564705+0000","last_change":"2024-04-25T10:33:43.183071+0000","last_active":"2024-04-25T10:33:45.564705+0000","last_peered":"2024-04-25T10:33:45.564705+0000","last_clean":"2024-04-25T10:33:45.564705+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:33:45.564705+0000","last_undegraded":"2024-04-25T10:33:45.564705+0000","last_fullsized":"2024-04-25T10:33:45.564705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563277+0000","last_change":"2024-04-25T10:33:43.179022+0000","last_active":"2024-04-25T10:33:45.563277+0000","last_peered":"2024-04-25T10:33:45.563277+0000","last_clean":"2024-04-25T10:33:45.563277+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:33:45.563277+0000","last_undegraded":"2024-04-25T10:33:45.563277+0000","last_fullsized":"2024-04-25T10:33:45.563277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564322+0000","last_change":"2024-04-25T10:33:43.186661+0000","last_active":"2024-04-25T10:33:45.564322+0000","last_peered":"2024-04-25T10:33:45.564322+0000","last_clean":"2024-04-25T10:33:45.564322+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:33:45.564322+0000","last_undegraded":"2024-04-25T10:33:45.564322+0000","last_fullsized":"2024-04-25T10:33:45.564322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.758005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063277+0000","last_change":"2024-04-25T10:33:43.175801+0000","last_active":"2024-04-25T10:33:45.063277+0000","last_peered":"2024-04-25T10:33:45.063277+0000","last_clean":"2024-04-25T10:33:45.063277+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:33:45.063277+0000","last_undegraded":"2024-04-25T10:33:45.063277+0000","last_fullsized":"2024-04-25T10:33:45.063277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167037+0000","last_change":"2024-04-25T10:33:43.183056+0000","last_active":"2024-04-25T10:33:44.167037+0000","last_peered":"2024-04-25T10:33:44.167037+0000","last_clean":"2024-04-25T10:33:44.167037+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:33:44.167037+0000","last_undegraded":"2024-04-25T10:33:44.167037+0000","last_fullsized":"2024-04-25T10:33:44.167037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564030+0000","last_change":"2024-04-25T10:33:43.180388+0000","last_active":"2024-04-25T10:33:45.564030+0000","last_peered":"2024-04-25T10:33:45.564030+0000","last_clean":"2024-04-25T10:33:45.564030+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:33:45.564030+0000","last_undegraded":"2024-04-25T10:33:45.564030+0000","last_fullsized":"2024-04-25T10:33:45.564030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167865+0000","last_change":"2024-04-25T10:33:43.162216+0000","last_active":"2024-04-25T10:33:44.167865+0000","last_peered":"2024-04-25T10:33:44.167865+0000","last_clean":"2024-04-25T10:33:44.167865+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:33:44.167865+0000","last_undegraded":"2024-04-25T10:33:44.167865+0000","last_fullsized":"2024-04-25T10:33:44.167865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563722+0000","last_change":"2024-04-25T10:33:43.183734+0000","last_active":"2024-04-25T10:33:45.563722+0000","last_peered":"2024-04-25T10:33:45.563722+0000","last_clean":"2024-04-25T10:33:45.563722+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:33:45.563722+0000","last_undegraded":"2024-04-25T10:33:45.563722+0000","last_fullsized":"2024-04-25T10:33:45.563722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168353+0000","last_change":"2024-04-25T10:33:43.167323+0000","last_active":"2024-04-25T10:33:44.168353+0000","last_peered":"2024-04-25T10:33:44.168353+0000","last_clean":"2024-04-25T10:33:44.168353+0000","last_became_active":"2024-04-25T10:33:43.166975+0000","last_became_peered":"2024-04-25T10:33:43.166975+0000","last_unstale":"2024-04-25T10:33:44.168353+0000","last_undegraded":"2024-04-25T10:33:44.168353+0000","last_fullsized":"2024-04-25T10:33:44.168353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063622+0000","last_change":"2024-04-25T10:33:43.183648+0000","last_active":"2024-04-25T10:33:45.063622+0000","last_peered":"2024-04-25T10:33:45.063622+0000","last_clean":"2024-04-25T10:33:45.063622+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:33:45.063622+0000","last_undegraded":"2024-04-25T10:33:45.063622+0000","last_fullsized":"2024-04-25T10:33:45.063622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065076+0000","last_change":"2024-04-25T10:33:43.175229+0000","last_active":"2024-04-25T10:33:45.065076+0000","last_peered":"2024-04-25T10:33:45.065076+0000","last_clean":"2024-04-25T10:33:45.065076+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:33:45.065076+0000","last_undegraded":"2024-04-25T10:33:45.065076+0000","last_fullsized":"2024-04-25T10:33:45.065076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168339+0000","last_change":"2024-04-25T10:33:43.162579+0000","last_active":"2024-04-25T10:33:44.168339+0000","last_peered":"2024-04-25T10:33:44.168339+0000","last_clean":"2024-04-25T10:33:44.168339+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:33:44.168339+0000","last_undegraded":"2024-04-25T10:33:44.168339+0000","last_fullsized":"2024-04-25T10:33:44.168339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167166+0000","last_change":"2024-04-25T10:33:43.168576+0000","last_active":"2024-04-25T10:33:44.167166+0000","last_peered":"2024-04-25T10:33:44.167166+0000","last_clean":"2024-04-25T10:33:44.167166+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:33:44.167166+0000","last_undegraded":"2024-04-25T10:33:44.167166+0000","last_fullsized":"2024-04-25T10:33:44.167166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564440+0000","last_change":"2024-04-25T10:33:43.182970+0000","last_active":"2024-04-25T10:33:45.564440+0000","last_peered":"2024-04-25T10:33:45.564440+0000","last_clean":"2024-04-25T10:33:45.564440+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:33:45.564440+0000","last_undegraded":"2024-04-25T10:33:45.564440+0000","last_fullsized":"2024-04-25T10:33:45.564440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563073+0000","last_change":"2024-04-25T10:33:43.171456+0000","last_active":"2024-04-25T10:33:45.563073+0000","last_peered":"2024-04-25T10:33:45.563073+0000","last_clean":"2024-04-25T10:33:45.563073+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:33:45.563073+0000","last_undegraded":"2024-04-25T10:33:45.563073+0000","last_fullsized":"2024-04-25T10:33:45.563073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063096+0000","last_change":"2024-04-25T10:33:43.183419+0000","last_active":"2024-04-25T10:33:45.063096+0000","last_peered":"2024-04-25T10:33:45.063096+0000","last_clean":"2024-04-25T10:33:45.063096+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:33:45.063096+0000","last_undegraded":"2024-04-25T10:33:45.063096+0000","last_fullsized":"2024-04-25T10:33:45.063096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168586+0000","last_change":"2024-04-25T10:33:43.170134+0000","last_active":"2024-04-25T10:33:44.168586+0000","last_peered":"2024-04-25T10:33:44.168586+0000","last_clean":"2024-04-25T10:33:44.168586+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:33:44.168586+0000","last_undegraded":"2024-04-25T10:33:44.168586+0000","last_fullsized":"2024-04-25T10:33:44.168586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:06.463548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168273+0000","last_change":"2024-04-25T10:33:42.162138+0000","last_active":"2024-04-25T10:33:44.168273+0000","last_peered":"2024-04-25T10:33:44.168273+0000","last_clean":"2024-04-25T10:33:44.168273+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:33:44.168273+0000","last_undegraded":"2024-04-25T10:33:44.168273+0000","last_fullsized":"2024-04-25T10:33:44.168273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167155+0000","last_change":"2024-04-25T10:33:43.172141+0000","last_active":"2024-04-25T10:33:44.167155+0000","last_peered":"2024-04-25T10:33:44.167155+0000","last_clean":"2024-04-25T10:33:44.167155+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:33:44.167155+0000","last_undegraded":"2024-04-25T10:33:44.167155+0000","last_fullsized":"2024-04-25T10:33:44.167155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063005+0000","last_change":"2024-04-25T10:33:42.161614+0000","last_active":"2024-04-25T10:33:45.063005+0000","last_peered":"2024-04-25T10:33:45.063005+0000","last_clean":"2024-04-25T10:33:45.063005+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:33:45.063005+0000","last_undegraded":"2024-04-25T10:33:45.063005+0000","last_fullsized":"2024-04-25T10:33:45.063005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167835+0000","last_change":"2024-04-25T10:33:42.158934+0000","last_active":"2024-04-25T10:33:44.167835+0000","last_peered":"2024-04-25T10:33:44.167835+0000","last_clean":"2024-04-25T10:33:44.167835+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:33:44.167835+0000","last_undegraded":"2024-04-25T10:33:44.167835+0000","last_fullsized":"2024-04-25T10:33:44.167835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168337+0000","last_change":"2024-04-25T10:33:43.170270+0000","last_active":"2024-04-25T10:33:44.168337+0000","last_peered":"2024-04-25T10:33:44.168337+0000","last_clean":"2024-04-25T10:33:44.168337+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:33:44.168337+0000","last_undegraded":"2024-04-25T10:33:44.168337+0000","last_fullsized":"2024-04-25T10:33:44.168337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563940+0000","last_change":"2024-04-25T10:33:42.162167+0000","last_active":"2024-04-25T10:33:45.563940+0000","last_peered":"2024-04-25T10:33:45.563940+0000","last_clean":"2024-04-25T10:33:45.563940+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:33:45.563940+0000","last_undegraded":"2024-04-25T10:33:45.563940+0000","last_fullsized":"2024-04-25T10:33:45.563940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064954+0000","last_change":"2024-04-25T10:33:43.174366+0000","last_active":"2024-04-25T10:33:45.064954+0000","last_peered":"2024-04-25T10:33:45.064954+0000","last_clean":"2024-04-25T10:33:45.064954+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:33:45.064954+0000","last_undegraded":"2024-04-25T10:33:45.064954+0000","last_fullsized":"2024-04-25T10:33:45.064954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063378+0000","last_change":"2024-04-25T10:33:42.163161+0000","last_active":"2024-04-25T10:33:45.063378+0000","last_peered":"2024-04-25T10:33:45.063378+0000","last_clean":"2024-04-25T10:33:45.063378+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:33:45.063378+0000","last_undegraded":"2024-04-25T10:33:45.063378+0000","last_fullsized":"2024-04-25T10:33:45.063378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563968+0000","last_change":"2024-04-25T10:33:43.179159+0000","last_active":"2024-04-25T10:33:45.563968+0000","last_peered":"2024-04-25T10:33:45.563968+0000","last_clean":"2024-04-25T10:33:45.563968+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:33:45.563968+0000","last_undegraded":"2024-04-25T10:33:45.563968+0000","last_fullsized":"2024-04-25T10:33:45.563968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564180+0000","last_change":"2024-04-25T10:33:42.168608+0000","last_active":"2024-04-25T10:33:45.564180+0000","last_peered":"2024-04-25T10:33:45.564180+0000","last_clean":"2024-04-25T10:33:45.564180+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:33:45.564180+0000","last_undegraded":"2024-04-25T10:33:45.564180+0000","last_fullsized":"2024-04-25T10:33:45.564180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167316+0000","last_change":"2024-04-25T10:33:43.172553+0000","last_active":"2024-04-25T10:33:44.167316+0000","last_peered":"2024-04-25T10:33:44.167316+0000","last_clean":"2024-04-25T10:33:44.167316+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:33:44.167316+0000","last_undegraded":"2024-04-25T10:33:44.167316+0000","last_fullsized":"2024-04-25T10:33:44.167316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065060+0000","last_change":"2024-04-25T10:33:42.160656+0000","last_active":"2024-04-25T10:33:45.065060+0000","last_peered":"2024-04-25T10:33:45.065060+0000","last_clean":"2024-04-25T10:33:45.065060+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:33:45.065060+0000","last_undegraded":"2024-04-25T10:33:45.065060+0000","last_fullsized":"2024-04-25T10:33:45.065060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:16.669213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168940+0000","last_change":"2024-04-25T10:33:43.178426+0000","last_active":"2024-04-25T10:33:44.168940+0000","last_peered":"2024-04-25T10:33:44.168940+0000","last_clean":"2024-04-25T10:33:44.168940+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:33:44.168940+0000","last_undegraded":"2024-04-25T10:33:44.168940+0000","last_fullsized":"2024-04-25T10:33:44.168940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063183+0000","last_change":"2024-04-25T10:33:42.160251+0000","last_active":"2024-04-25T10:33:45.063183+0000","last_peered":"2024-04-25T10:33:45.063183+0000","last_clean":"2024-04-25T10:33:45.063183+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:33:45.063183+0000","last_undegraded":"2024-04-25T10:33:45.063183+0000","last_fullsized":"2024-04-25T10:33:45.063183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563799+0000","last_change":"2024-04-25T10:33:43.180666+0000","last_active":"2024-04-25T10:33:45.563799+0000","last_peered":"2024-04-25T10:33:45.563799+0000","last_clean":"2024-04-25T10:33:45.563799+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:33:45.563799+0000","last_undegraded":"2024-04-25T10:33:45.563799+0000","last_fullsized":"2024-04-25T10:33:45.563799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167270+0000","last_change":"2024-04-25T10:33:42.164005+0000","last_active":"2024-04-25T10:33:44.167270+0000","last_peered":"2024-04-25T10:33:44.167270+0000","last_clean":"2024-04-25T10:33:44.167270+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:33:44.167270+0000","last_undegraded":"2024-04-25T10:33:44.167270+0000","last_fullsized":"2024-04-25T10:33:44.167270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:54.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166893+0000","last_change":"2024-04-25T10:33:43.181483+0000","last_active":"2024-04-25T10:33:44.166893+0000","last_peered":"2024-04-25T10:33:44.166893+0000","last_clean":"2024-04-25T10:33:44.166893+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:33:44.166893+0000","last_undegraded":"2024-04-25T10:33:44.166893+0000","last_fullsized":"2024-04-25T10:33:44.166893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:42.713890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564604+0000","last_change":"2024-04-25T10:33:42.163146+0000","last_active":"2024-04-25T10:33:45.564604+0000","last_peered":"2024-04-25T10:33:45.564604+0000","last_clean":"2024-04-25T10:33:45.564604+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:33:45.564604+0000","last_undegraded":"2024-04-25T10:33:45.564604+0000","last_fullsized":"2024-04-25T10:33:45.564604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564706+0000","last_change":"2024-04-25T10:33:43.183314+0000","last_active":"2024-04-25T10:33:45.564706+0000","last_peered":"2024-04-25T10:33:45.564706+0000","last_clean":"2024-04-25T10:33:45.564706+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:33:45.564706+0000","last_undegraded":"2024-04-25T10:33:45.564706+0000","last_fullsized":"2024-04-25T10:33:45.564706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:07.841471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.062968+0000","last_change":"2024-04-25T10:33:42.166542+0000","last_active":"2024-04-25T10:33:45.062968+0000","last_peered":"2024-04-25T10:33:45.062968+0000","last_clean":"2024-04-25T10:33:45.062968+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:33:45.062968+0000","last_undegraded":"2024-04-25T10:33:45.062968+0000","last_fullsized":"2024-04-25T10:33:45.062968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063134+0000","last_change":"2024-04-25T10:33:43.176217+0000","last_active":"2024-04-25T10:33:45.063134+0000","last_peered":"2024-04-25T10:33:45.063134+0000","last_clean":"2024-04-25T10:33:45.063134+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:33:45.063134+0000","last_undegraded":"2024-04-25T10:33:45.063134+0000","last_fullsized":"2024-04-25T10:33:45.063134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.562984+0000","last_change":"2024-04-25T10:33:42.156163+0000","last_active":"2024-04-25T10:33:45.562984+0000","last_peered":"2024-04-25T10:33:45.562984+0000","last_clean":"2024-04-25T10:33:45.562984+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:33:45.562984+0000","last_undegraded":"2024-04-25T10:33:45.562984+0000","last_fullsized":"2024-04-25T10:33:45.562984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563910+0000","last_change":"2024-04-25T10:33:43.183091+0000","last_active":"2024-04-25T10:33:45.563910+0000","last_peered":"2024-04-25T10:33:45.563910+0000","last_clean":"2024-04-25T10:33:45.563910+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:33:45.563910+0000","last_undegraded":"2024-04-25T10:33:45.563910+0000","last_fullsized":"2024-04-25T10:33:45.563910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.169208+0000","last_change":"2024-04-25T10:33:42.162393+0000","last_active":"2024-04-25T10:33:44.169208+0000","last_peered":"2024-04-25T10:33:44.169208+0000","last_clean":"2024-04-25T10:33:44.169208+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:33:44.169208+0000","last_undegraded":"2024-04-25T10:33:44.169208+0000","last_fullsized":"2024-04-25T10:33:44.169208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:57.969551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564904+0000","last_change":"2024-04-25T10:33:43.183207+0000","last_active":"2024-04-25T10:33:45.564904+0000","last_peered":"2024-04-25T10:33:45.564904+0000","last_clean":"2024-04-25T10:33:45.564904+0000","last_became_active":"2024-04-25T10:33:43.182885+0000","last_became_peered":"2024-04-25T10:33:43.182885+0000","last_unstale":"2024-04-25T10:33:45.564904+0000","last_undegraded":"2024-04-25T10:33:45.564904+0000","last_fullsized":"2024-04-25T10:33:45.564904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:25.864847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563260+0000","last_change":"2024-04-25T10:33:42.159468+0000","last_active":"2024-04-25T10:33:45.563260+0000","last_peered":"2024-04-25T10:33:45.563260+0000","last_clean":"2024-04-25T10:33:45.563260+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:33:45.563260+0000","last_undegraded":"2024-04-25T10:33:45.563260+0000","last_fullsized":"2024-04-25T10:33:45.563260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.565181+0000","last_change":"2024-04-25T10:33:43.181841+0000","last_active":"2024-04-25T10:33:45.565181+0000","last_peered":"2024-04-25T10:33:45.565181+0000","last_clean":"2024-04-25T10:33:45.565181+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:33:45.565181+0000","last_undegraded":"2024-04-25T10:33:45.565181+0000","last_fullsized":"2024-04-25T10:33:45.565181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:37.937673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065207+0000","last_change":"2024-04-25T10:33:42.152094+0000","last_active":"2024-04-25T10:33:45.065207+0000","last_peered":"2024-04-25T10:33:45.065207+0000","last_clean":"2024-04-25T10:33:45.065207+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:33:45.065207+0000","last_undegraded":"2024-04-25T10:33:45.065207+0000","last_fullsized":"2024-04-25T10:33:45.065207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.924435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564432+0000","last_change":"2024-04-25T10:33:43.177222+0000","last_active":"2024-04-25T10:33:45.564432+0000","last_peered":"2024-04-25T10:33:45.564432+0000","last_clean":"2024-04-25T10:33:45.564432+0000","last_became_active":"2024-04-25T10:33:43.173582+0000","last_became_peered":"2024-04-25T10:33:43.173582+0000","last_unstale":"2024-04-25T10:33:45.564432+0000","last_undegraded":"2024-04-25T10:33:45.564432+0000","last_fullsized":"2024-04-25T10:33:45.564432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:21.953612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563175+0000","last_change":"2024-04-25T10:33:42.167140+0000","last_active":"2024-04-25T10:33:45.563175+0000","last_peered":"2024-04-25T10:33:45.563175+0000","last_clean":"2024-04-25T10:33:45.563175+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:33:45.563175+0000","last_undegraded":"2024-04-25T10:33:45.563175+0000","last_fullsized":"2024-04-25T10:33:45.563175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564021+0000","last_change":"2024-04-25T10:33:43.184750+0000","last_active":"2024-04-25T10:33:45.564021+0000","last_peered":"2024-04-25T10:33:45.564021+0000","last_clean":"2024-04-25T10:33:45.564021+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:33:45.564021+0000","last_undegraded":"2024-04-25T10:33:45.564021+0000","last_fullsized":"2024-04-25T10:33:45.564021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563599+0000","last_change":"2024-04-25T10:33:31.708843+0000","last_active":"2024-04-25T10:33:45.563599+0000","last_peered":"2024-04-25T10:33:45.563599+0000","last_clean":"2024-04-25T10:33:45.563599+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:33:45.563599+0000","last_undegraded":"2024-04-25T10:33:45.563599+0000","last_fullsized":"2024-04-25T10:33:45.563599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_clean_scrub_stamp":"2024-04-25T10:33:30.626866+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:10.475782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563669+0000","last_change":"2024-04-25T10:33:42.164505+0000","last_active":"2024-04-25T10:33:45.563669+0000","last_peered":"2024-04-25T10:33:45.563669+0000","last_clean":"2024-04-25T10:33:45.563669+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:33:45.563669+0000","last_undegraded":"2024-04-25T10:33:45.563669+0000","last_fullsized":"2024-04-25T10:33:45.563669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167927+0000","last_change":"2024-04-25T10:33:43.169958+0000","last_active":"2024-04-25T10:33:44.167927+0000","last_peered":"2024-04-25T10:33:44.167927+0000","last_clean":"2024-04-25T10:33:44.167927+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:33:44.167927+0000","last_undegraded":"2024-04-25T10:33:44.167927+0000","last_fullsized":"2024-04-25T10:33:44.167927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563434+0000","last_change":"2024-04-25T10:33:42.163852+0000","last_active":"2024-04-25T10:33:45.563434+0000","last_peered":"2024-04-25T10:33:45.563434+0000","last_clean":"2024-04-25T10:33:45.563434+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:33:45.563434+0000","last_undegraded":"2024-04-25T10:33:45.563434+0000","last_fullsized":"2024-04-25T10:33:45.563434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:28.602376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166780+0000","last_change":"2024-04-25T10:33:43.165039+0000","last_active":"2024-04-25T10:33:44.166780+0000","last_peered":"2024-04-25T10:33:44.166780+0000","last_clean":"2024-04-25T10:33:44.166780+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:33:44.166780+0000","last_undegraded":"2024-04-25T10:33:44.166780+0000","last_fullsized":"2024-04-25T10:33:44.166780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:30.822807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563144+0000","last_change":"2024-04-25T10:33:42.160012+0000","last_active":"2024-04-25T10:33:45.563144+0000","last_peered":"2024-04-25T10:33:45.563144+0000","last_clean":"2024-04-25T10:33:45.563144+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:33:45.563144+0000","last_undegraded":"2024-04-25T10:33:45.563144+0000","last_fullsized":"2024-04-25T10:33:45.563144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064963+0000","last_change":"2024-04-25T10:33:43.170473+0000","last_active":"2024-04-25T10:33:45.064963+0000","last_peered":"2024-04-25T10:33:45.064963+0000","last_clean":"2024-04-25T10:33:45.064963+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:33:45.064963+0000","last_undegraded":"2024-04-25T10:33:45.064963+0000","last_fullsized":"2024-04-25T10:33:45.064963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564704+0000","last_change":"2024-04-25T10:33:42.161197+0000","last_active":"2024-04-25T10:33:45.564704+0000","last_peered":"2024-04-25T10:33:45.564704+0000","last_clean":"2024-04-25T10:33:45.564704+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:33:45.564704+0000","last_undegraded":"2024-04-25T10:33:45.564704+0000","last_fullsized":"2024-04-25T10:33:45.564704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168672+0000","last_change":"2024-04-25T10:33:43.172447+0000","last_active":"2024-04-25T10:33:44.168672+0000","last_peered":"2024-04-25T10:33:44.168672+0000","last_clean":"2024-04-25T10:33:44.168672+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:33:44.168672+0000","last_undegraded":"2024-04-25T10:33:44.168672+0000","last_fullsized":"2024-04-25T10:33:44.168672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:19.195134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065155+0000","last_change":"2024-04-25T10:33:42.161100+0000","last_active":"2024-04-25T10:33:45.065155+0000","last_peered":"2024-04-25T10:33:45.065155+0000","last_clean":"2024-04-25T10:33:45.065155+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:33:45.065155+0000","last_undegraded":"2024-04-25T10:33:45.065155+0000","last_fullsized":"2024-04-25T10:33:45.065155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564491+0000","last_change":"2024-04-25T10:33:43.175361+0000","last_active":"2024-04-25T10:33:45.564491+0000","last_peered":"2024-04-25T10:33:45.564491+0000","last_clean":"2024-04-25T10:33:45.564491+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:33:45.564491+0000","last_undegraded":"2024-04-25T10:33:45.564491+0000","last_fullsized":"2024-04-25T10:33:45.564491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564430+0000","last_change":"2024-04-25T10:33:42.170292+0000","last_active":"2024-04-25T10:33:45.564430+0000","last_peered":"2024-04-25T10:33:45.564430+0000","last_clean":"2024-04-25T10:33:45.564430+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:33:45.564430+0000","last_undegraded":"2024-04-25T10:33:45.564430+0000","last_fullsized":"2024-04-25T10:33:45.564430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:47.392698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065123+0000","last_change":"2024-04-25T10:33:43.170285+0000","last_active":"2024-04-25T10:33:45.065123+0000","last_peered":"2024-04-25T10:33:45.065123+0000","last_clean":"2024-04-25T10:33:45.065123+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:33:45.065123+0000","last_undegraded":"2024-04-25T10:33:45.065123+0000","last_fullsized":"2024-04-25T10:33:45.065123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.170514+0000","last_change":"2024-04-25T10:33:42.160069+0000","last_active":"2024-04-25T10:33:45.170514+0000","last_peered":"2024-04-25T10:33:45.170514+0000","last_clean":"2024-04-25T10:33:45.170514+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:33:45.170514+0000","last_undegraded":"2024-04-25T10:33:45.170514+0000","last_fullsized":"2024-04-25T10:33:45.170514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168242+0000","last_change":"2024-04-25T10:33:43.181641+0000","last_active":"2024-04-25T10:33:44.168242+0000","last_peered":"2024-04-25T10:33:44.168242+0000","last_clean":"2024-04-25T10:33:44.168242+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:33:44.168242+0000","last_undegraded":"2024-04-25T10:33:44.168242+0000","last_fullsized":"2024-04-25T10:33:44.168242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063445+0000","last_change":"2024-04-25T10:33:42.165706+0000","last_active":"2024-04-25T10:33:45.063445+0000","last_peered":"2024-04-25T10:33:45.063445+0000","last_clean":"2024-04-25T10:33:45.063445+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:33:45.063445+0000","last_undegraded":"2024-04-25T10:33:45.063445+0000","last_fullsized":"2024-04-25T10:33:45.063445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167085+0000","last_change":"2024-04-25T10:33:43.173260+0000","last_active":"2024-04-25T10:33:44.167085+0000","last_peered":"2024-04-25T10:33:44.167085+0000","last_clean":"2024-04-25T10:33:44.167085+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:33:44.167085+0000","last_undegraded":"2024-04-25T10:33:44.167085+0000","last_fullsized":"2024-04-25T10:33:44.167085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563434+0000","last_change":"2024-04-25T10:33:42.166946+0000","last_active":"2024-04-25T10:33:45.563434+0000","last_peered":"2024-04-25T10:33:45.563434+0000","last_clean":"2024-04-25T10:33:45.563434+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:33:45.563434+0000","last_undegraded":"2024-04-25T10:33:45.563434+0000","last_fullsized":"2024-04-25T10:33:45.563434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:29.817932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168855+0000","last_change":"2024-04-25T10:33:43.170510+0000","last_active":"2024-04-25T10:33:44.168855+0000","last_peered":"2024-04-25T10:33:44.168855+0000","last_clean":"2024-04-25T10:33:44.168855+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:33:44.168855+0000","last_undegraded":"2024-04-25T10:33:44.168855+0000","last_fullsized":"2024-04-25T10:33:44.168855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065073+0000","last_change":"2024-04-25T10:33:42.165204+0000","last_active":"2024-04-25T10:33:45.065073+0000","last_peered":"2024-04-25T10:33:45.065073+0000","last_clean":"2024-04-25T10:33:45.065073+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:33:45.065073+0000","last_undegraded":"2024-04-25T10:33:45.065073+0000","last_fullsized":"2024-04-25T10:33:45.065073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167946+0000","last_change":"2024-04-25T10:33:43.168088+0000","last_active":"2024-04-25T10:33:44.167946+0000","last_peered":"2024-04-25T10:33:44.167946+0000","last_clean":"2024-04-25T10:33:44.167946+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:33:44.167946+0000","last_undegraded":"2024-04-25T10:33:44.167946+0000","last_fullsized":"2024-04-25T10:33:44.167946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065140+0000","last_change":"2024-04-25T10:33:42.156381+0000","last_active":"2024-04-25T10:33:45.065140+0000","last_peered":"2024-04-25T10:33:45.065140+0000","last_clean":"2024-04-25T10:33:45.065140+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:33:45.065140+0000","last_undegraded":"2024-04-25T10:33:45.065140+0000","last_fullsized":"2024-04-25T10:33:45.065140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168277+0000","last_change":"2024-04-25T10:33:43.167502+0000","last_active":"2024-04-25T10:33:44.168277+0000","last_peered":"2024-04-25T10:33:44.168277+0000","last_clean":"2024-04-25T10:33:44.168277+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:33:44.168277+0000","last_undegraded":"2024-04-25T10:33:44.168277+0000","last_fullsized":"2024-04-25T10:33:44.168277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564856+0000","last_change":"2024-04-25T10:33:42.168840+0000","last_active":"2024-04-25T10:33:45.564856+0000","last_peered":"2024-04-25T10:33:45.564856+0000","last_clean":"2024-04-25T10:33:45.564856+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:33:45.564856+0000","last_undegraded":"2024-04-25T10:33:45.564856+0000","last_fullsized":"2024-04-25T10:33:45.564856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:51.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063081+0000","last_change":"2024-04-25T10:33:43.174672+0000","last_active":"2024-04-25T10:33:45.063081+0000","last_peered":"2024-04-25T10:33:45.063081+0000","last_clean":"2024-04-25T10:33:45.063081+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:33:45.063081+0000","last_undegraded":"2024-04-25T10:33:45.063081+0000","last_fullsized":"2024-04-25T10:33:45.063081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564265+0000","last_change":"2024-04-25T10:33:43.179274+0000","last_active":"2024-04-25T10:33:45.564265+0000","last_peered":"2024-04-25T10:33:45.564265+0000","last_clean":"2024-04-25T10:33:45.564265+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:33:45.564265+0000","last_undegraded":"2024-04-25T10:33:45.564265+0000","last_fullsized":"2024-04-25T10:33:45.564265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:24.341521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563786+0000","last_change":"2024-04-25T10:33:42.168654+0000","last_active":"2024-04-25T10:33:45.563786+0000","last_peered":"2024-04-25T10:33:45.563786+0000","last_clean":"2024-04-25T10:33:45.563786+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:33:45.563786+0000","last_undegraded":"2024-04-25T10:33:45.563786+0000","last_fullsized":"2024-04-25T10:33:45.563786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:15.158541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564077+0000","last_change":"2024-04-25T10:33:43.170923+0000","last_active":"2024-04-25T10:33:45.564077+0000","last_peered":"2024-04-25T10:33:45.564077+0000","last_clean":"2024-04-25T10:33:45.564077+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:33:45.564077+0000","last_undegraded":"2024-04-25T10:33:45.564077+0000","last_fullsized":"2024-04-25T10:33:45.564077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564130+0000","last_change":"2024-04-25T10:33:42.171374+0000","last_active":"2024-04-25T10:33:45.564130+0000","last_peered":"2024-04-25T10:33:45.564130+0000","last_clean":"2024-04-25T10:33:45.564130+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:33:45.564130+0000","last_undegraded":"2024-04-25T10:33:45.564130+0000","last_fullsized":"2024-04-25T10:33:45.564130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:41.709015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167209+0000","last_change":"2024-04-25T10:33:43.172788+0000","last_active":"2024-04-25T10:33:44.167209+0000","last_peered":"2024-04-25T10:33:44.167209+0000","last_clean":"2024-04-25T10:33:44.167209+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:33:44.167209+0000","last_undegraded":"2024-04-25T10:33:44.167209+0000","last_fullsized":"2024-04-25T10:33:44.167209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168142+0000","last_change":"2024-04-25T10:33:42.161364+0000","last_active":"2024-04-25T10:33:44.168142+0000","last_peered":"2024-04-25T10:33:44.168142+0000","last_clean":"2024-04-25T10:33:44.168142+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:33:44.168142+0000","last_undegraded":"2024-04-25T10:33:44.168142+0000","last_fullsized":"2024-04-25T10:33:44.168142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168175+0000","last_change":"2024-04-25T10:33:43.177654+0000","last_active":"2024-04-25T10:33:44.168175+0000","last_peered":"2024-04-25T10:33:44.168175+0000","last_clean":"2024-04-25T10:33:44.168175+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:33:44.168175+0000","last_undegraded":"2024-04-25T10:33:44.168175+0000","last_fullsized":"2024-04-25T10:33:44.168175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167339+0000","last_change":"2024-04-25T10:33:42.167156+0000","last_active":"2024-04-25T10:33:44.167339+0000","last_peered":"2024-04-25T10:33:44.167339+0000","last_clean":"2024-04-25T10:33:44.167339+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:33:44.167339+0000","last_undegraded":"2024-04-25T10:33:44.167339+0000","last_fullsized":"2024-04-25T10:33:44.167339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:33:50.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:33:50.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.835+0000 7f1fbfdba640 1 Processor -- start 2024-04-25T10:33:50.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.835+0000 7f1fbfdba640 1 -- start start 2024-04-25T10:33:50.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.836+0000 7f1fbfdba640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1fb8149c60 0x7f1fb80ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.836+0000 7f1fbfdba640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb80b5790 con 0x7f1fb809c200 2024-04-25T10:33:50.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.836+0000 7f1fbfdba640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb814a2b0 con 0x7f1fb809ddc0 2024-04-25T10:33:50.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.836+0000 7f1fbfdba640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb814a070 con 0x7f1fb8149c60 2024-04-25T10:33:50.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.836+0000 7f1fbdb56640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1fb809c200 0x7f1fb809d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33160/0 (socket says 172.21.15.103:33160) 2024-04-25T10:33:50.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.836+0000 7f1fbdb56640 1 -- 172.21.15.103:0/1407675775 learned_addr learned my addr 172.21.15.103:0/1407675775 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:50.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbe357640 1 --2- 172.21.15.103:0/1407675775 >> v2:172.21.15.132:3300/0 conn(0x7f1fb8149c60 0x7f1fb80ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389509274 0 0) 0x7f1fb80b5790 con 0x7f1fb809c200 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa4003520 con 0x7f1fb809c200 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1978382162 0 0) 0x7f1fa4003520 con 0x7f1fb809c200 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 >> v2:172.21.15.132:3300/0 conn(0x7f1fb8149c60 msgr2=0x7f1fb80ba9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 --2- 172.21.15.103:0/1407675775 >> v2:172.21.15.132:3300/0 conn(0x7f1fb8149c60 0x7f1fb80ba9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 >> v1:172.21.15.132:6789/0 conn(0x7f1fb809ddc0 legacy=0x7f1fb8149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb809d190 con 0x7f1fb809c200 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f1fb4001670 con 0x7f1fb809c200 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 >> v1:172.21.15.103:6789/0 conn(0x7f1fb809c200 legacy=0x7f1fb809d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa40039b0 0x7f1fa4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fa4004800 0x7f1fa4004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa4005250 0x7f1fa400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb814a070 con 0x7f1fa4005250 2024-04-25T10:33:50.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa400c1e0 con 0x7f1fa40039b0 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa400c3e0 con 0x7f1fa4004800 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbe357640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa4005250 0x7f1fa400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbdb56640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa40039b0 0x7f1fa4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbd355640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fa4004800 0x7f1fa4004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbe357640 1 -- 172.21.15.103:0/1407675775 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fa4004800 msgr2=0x7f1fa4004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbe357640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fa4004800 0x7f1fa4004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbe357640 1 -- 172.21.15.103:0/1407675775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa40039b0 msgr2=0x7f1fa4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbe357640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa40039b0 0x7f1fa4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.837+0000 7f1fbe357640 1 -- 172.21.15.103:0/1407675775 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa4003520 con 0x7f1fa4005250 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.838+0000 7f1fbe357640 1 -- 172.21.15.103:0/1407675775 reap_dead start 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.838+0000 7f1fbe357640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa4005250 0x7f1fa400b9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80b2470 tx=0x7f1fa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e456e21a7705e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.838+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0035020 con 0x7f1fa4005250 2024-04-25T10:33:50.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.838+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb0003b90 con 0x7f1fa4005250 2024-04-25T10:33:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.838+0000 7f1fbcb54640 1 -- 172.21.15.103:0/1407675775 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0009c10 con 0x7f1fa4005250 2024-04-25T10:33:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.839+0000 7f1fbfdba640 1 -- 172.21.15.103:0/1407675775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa4005250 msgr2=0x7f1fa400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.839+0000 7f1fbfdba640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa4005250 0x7f1fa400b9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80b2470 tx=0x7f1fa4005830 comp rx=0 tx=0).stop 2024-04-25T10:33:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.839+0000 7f1fbfdba640 1 -- 172.21.15.103:0/1407675775 shutdown_connections 2024-04-25T10:33:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.839+0000 7f1fbfdba640 1 --2- 172.21.15.103:0/1407675775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fa4005250 0x7f1fa400b9c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.839+0000 7f1fbfdba640 1 -- 172.21.15.103:0/1407675775 >> 172.21.15.103:0/1407675775 conn(0x7f1fb80bb5d0 msgr2=0x7f1fb80bb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.839+0000 7f1fbfdba640 1 -- 172.21.15.103:0/1407675775 shutdown_connections 2024-04-25T10:33:50.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.839+0000 7f1fbfdba640 1 -- 172.21.15.103:0/1407675775 wait complete. 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.840+0000 7f1fbfdba640 1 Processor -- start 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.841+0000 7f1fbfdba640 1 -- start start 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.841+0000 7f1fbfdba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa4005250 0x7f1fb80a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.841+0000 7f1fbfdba640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fb81e2d10 0x7f1fb8145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.841+0000 7f1fbfdba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fb8146070 0x7f1fb814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.841+0000 7f1fbfdba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb80bad60 con 0x7f1fb8146070 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.841+0000 7f1fbfdba640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb80babe0 con 0x7f1fa4005250 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.841+0000 7f1fbfdba640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb809d6b0 con 0x7f1fb81e2d10 2024-04-25T10:33:50.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fb8146070 0x7f1fb814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fb8146070 0x7f1fb814c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49084/0 (socket says 172.21.15.103:49084) 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 -- 172.21.15.103:0/2538700962 learned_addr learned my addr 172.21.15.103:0/2538700962 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbdb56640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa4005250 0x7f1fb80a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 -- 172.21.15.103:0/2538700962 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fb81e2d10 msgr2=0x7f1fb8145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbd355640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fb81e2d10 0x7f1fb8145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fb81e2d10 0x7f1fb8145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 -- 172.21.15.103:0/2538700962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa4005250 msgr2=0x7f1fb80a38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa4005250 0x7f1fb80a38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 -- 172.21.15.103:0/2538700962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb80b3050 con 0x7f1fb8146070 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbe357640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fb8146070 0x7f1fb814c5c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fb002aeb0 tx=0x7f1fb0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fae7fc640 1 -- 172.21.15.103:0/2538700962 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0035030 con 0x7f1fb8146070 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fae7fc640 1 -- 172.21.15.103:0/2538700962 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb0042070 con 0x7f1fb8146070 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb80b2a90 con 0x7f1fb8146070 2024-04-25T10:33:50.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fae7fc640 1 -- 172.21.15.103:0/2538700962 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0009c10 con 0x7f1fb8146070 2024-04-25T10:33:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.842+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb814d890 con 0x7f1fb8146070 2024-04-25T10:33:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.843+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb806a130 con 0x7f1fb8146070 2024-04-25T10:33:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.844+0000 7f1fae7fc640 1 -- 172.21.15.103:0/2538700962 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1fb0005d10 con 0x7f1fb8146070 2024-04-25T10:33:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.844+0000 7f1fae7fc640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f9c0744e0 0x7f1f9c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.844+0000 7f1fae7fc640 1 -- 172.21.15.103:0/2538700962 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1fb00b5cb0 con 0x7f1fb8146070 2024-04-25T10:33:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.844+0000 7f1fbdb56640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f9c0744e0 0x7f1f9c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:50.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.845+0000 7f1fbdb56640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f9c0744e0 0x7f1f9c0769f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4001050 tx=0x7f1fb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:50.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:50.849+0000 7f1fae7fc640 1 -- 172.21.15.103:0/2538700962 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1fb80b3050 con 0x7f1fb8146070 2024-04-25T10:33:51.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.021+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fb80b2880 con 0x7f1f9c0744e0 2024-04-25T10:33:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.027+0000 7f1fae7fc640 1 -- 172.21.15.103:0/2538700962 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251861 (secure 0 0 0) 0x7f1fb80b2880 con 0x7f1f9c0744e0 2024-04-25T10:33:51.031 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:51.032 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:33:51.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f9c0744e0 msgr2=0x7f1f9c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f9c0744e0 0x7f1f9c0769f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4001050 tx=0x7f1fb4009040 comp rx=0 tx=0).stop 2024-04-25T10:33:51.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fb8146070 msgr2=0x7f1fb814c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fb8146070 0x7f1fb814c5c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fb002aeb0 tx=0x7f1fb0009750 comp rx=0 tx=0).stop 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 shutdown_connections 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f9c0744e0 0x7f1f9c0769f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fb8146070 0x7f1fb814c5c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1fb81e2d10 0x7f1fb8145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 --2- 172.21.15.103:0/2538700962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1fa4005250 0x7f1fb80a38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 >> 172.21.15.103:0/2538700962 conn(0x7f1fb80bb5d0 msgr2=0x7f1fb806daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 shutdown_connections 2024-04-25T10:33:51.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.030+0000 7f1fbfdba640 1 -- 172.21.15.103:0/2538700962 wait complete. 2024-04-25T10:33:51.043 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T10:33:50.492734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001638"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.565060+0000","last_change":"2024-04-25T10:33:43.181183+0000","last_active":"2024-04-25T10:33:45.565060+0000","last_peered":"2024-04-25T10:33:45.565060+0000","last_clean":"2024-04-25T10:33:45.565060+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:33:45.565060+0000","last_undegraded":"2024-04-25T10:33:45.565060+0000","last_fullsized":"2024-04-25T10:33:45.565060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:44.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065236+0000","last_change":"2024-04-25T10:33:43.170436+0000","last_active":"2024-04-25T10:33:45.065236+0000","last_peered":"2024-04-25T10:33:45.065236+0000","last_clean":"2024-04-25T10:33:45.065236+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:33:45.065236+0000","last_undegraded":"2024-04-25T10:33:45.065236+0000","last_fullsized":"2024-04-25T10:33:45.065236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167080+0000","last_change":"2024-04-25T10:33:43.181271+0000","last_active":"2024-04-25T10:33:44.167080+0000","last_peered":"2024-04-25T10:33:44.167080+0000","last_clean":"2024-04-25T10:33:44.167080+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:33:44.167080+0000","last_undegraded":"2024-04-25T10:33:44.167080+0000","last_fullsized":"2024-04-25T10:33:44.167080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563903+0000","last_change":"2024-04-25T10:33:43.176831+0000","last_active":"2024-04-25T10:33:45.563903+0000","last_peered":"2024-04-25T10:33:45.563903+0000","last_clean":"2024-04-25T10:33:45.563903+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:33:45.563903+0000","last_undegraded":"2024-04-25T10:33:45.563903+0000","last_fullsized":"2024-04-25T10:33:45.563903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564659+0000","last_change":"2024-04-25T10:33:43.181222+0000","last_active":"2024-04-25T10:33:45.564659+0000","last_peered":"2024-04-25T10:33:45.564659+0000","last_clean":"2024-04-25T10:33:45.564659+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:33:45.564659+0000","last_undegraded":"2024-04-25T10:33:45.564659+0000","last_fullsized":"2024-04-25T10:33:45.564659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:42.544249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564587+0000","last_change":"2024-04-25T10:33:43.175444+0000","last_active":"2024-04-25T10:33:45.564587+0000","last_peered":"2024-04-25T10:33:45.564587+0000","last_clean":"2024-04-25T10:33:45.564587+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:33:45.564587+0000","last_undegraded":"2024-04-25T10:33:45.564587+0000","last_fullsized":"2024-04-25T10:33:45.564587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564240+0000","last_change":"2024-04-25T10:33:43.186303+0000","last_active":"2024-04-25T10:33:45.564240+0000","last_peered":"2024-04-25T10:33:45.564240+0000","last_clean":"2024-04-25T10:33:45.564240+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:33:45.564240+0000","last_undegraded":"2024-04-25T10:33:45.564240+0000","last_fullsized":"2024-04-25T10:33:45.564240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167768+0000","last_change":"2024-04-25T10:33:43.169919+0000","last_active":"2024-04-25T10:33:44.167768+0000","last_peered":"2024-04-25T10:33:44.167768+0000","last_clean":"2024-04-25T10:33:44.167768+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:33:44.167768+0000","last_undegraded":"2024-04-25T10:33:44.167768+0000","last_fullsized":"2024-04-25T10:33:44.167768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.565074+0000","last_change":"2024-04-25T10:33:43.183760+0000","last_active":"2024-04-25T10:33:45.565074+0000","last_peered":"2024-04-25T10:33:45.565074+0000","last_clean":"2024-04-25T10:33:45.565074+0000","last_became_active":"2024-04-25T10:33:43.183460+0000","last_became_peered":"2024-04-25T10:33:43.183460+0000","last_unstale":"2024-04-25T10:33:45.565074+0000","last_undegraded":"2024-04-25T10:33:45.565074+0000","last_fullsized":"2024-04-25T10:33:45.565074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:06.866677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063510+0000","last_change":"2024-04-25T10:33:43.175552+0000","last_active":"2024-04-25T10:33:45.063510+0000","last_peered":"2024-04-25T10:33:45.063510+0000","last_clean":"2024-04-25T10:33:45.063510+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:33:45.063510+0000","last_undegraded":"2024-04-25T10:33:45.063510+0000","last_fullsized":"2024-04-25T10:33:45.063510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063291+0000","last_change":"2024-04-25T10:33:43.175526+0000","last_active":"2024-04-25T10:33:45.063291+0000","last_peered":"2024-04-25T10:33:45.063291+0000","last_clean":"2024-04-25T10:33:45.063291+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:33:45.063291+0000","last_undegraded":"2024-04-25T10:33:45.063291+0000","last_fullsized":"2024-04-25T10:33:45.063291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168832+0000","last_change":"2024-04-25T10:33:43.176506+0000","last_active":"2024-04-25T10:33:44.168832+0000","last_peered":"2024-04-25T10:33:44.168832+0000","last_clean":"2024-04-25T10:33:44.168832+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:33:44.168832+0000","last_undegraded":"2024-04-25T10:33:44.168832+0000","last_fullsized":"2024-04-25T10:33:44.168832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:54.213946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168167+0000","last_change":"2024-04-25T10:33:43.178091+0000","last_active":"2024-04-25T10:33:44.168167+0000","last_peered":"2024-04-25T10:33:44.168167+0000","last_clean":"2024-04-25T10:33:44.168167+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:33:44.168167+0000","last_undegraded":"2024-04-25T10:33:44.168167+0000","last_fullsized":"2024-04-25T10:33:44.168167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166881+0000","last_change":"2024-04-25T10:33:43.173440+0000","last_active":"2024-04-25T10:33:44.166881+0000","last_peered":"2024-04-25T10:33:44.166881+0000","last_clean":"2024-04-25T10:33:44.166881+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:33:44.166881+0000","last_undegraded":"2024-04-25T10:33:44.166881+0000","last_fullsized":"2024-04-25T10:33:44.166881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.607252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064963+0000","last_change":"2024-04-25T10:33:43.172566+0000","last_active":"2024-04-25T10:33:45.064963+0000","last_peered":"2024-04-25T10:33:45.064963+0000","last_clean":"2024-04-25T10:33:45.064963+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:33:45.064963+0000","last_undegraded":"2024-04-25T10:33:45.064963+0000","last_fullsized":"2024-04-25T10:33:45.064963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563605+0000","last_change":"2024-04-25T10:33:43.175162+0000","last_active":"2024-04-25T10:33:45.563605+0000","last_peered":"2024-04-25T10:33:45.563605+0000","last_clean":"2024-04-25T10:33:45.563605+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:33:45.563605+0000","last_undegraded":"2024-04-25T10:33:45.563605+0000","last_fullsized":"2024-04-25T10:33:45.563605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564705+0000","last_change":"2024-04-25T10:33:43.183071+0000","last_active":"2024-04-25T10:33:45.564705+0000","last_peered":"2024-04-25T10:33:45.564705+0000","last_clean":"2024-04-25T10:33:45.564705+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:33:45.564705+0000","last_undegraded":"2024-04-25T10:33:45.564705+0000","last_fullsized":"2024-04-25T10:33:45.564705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563277+0000","last_change":"2024-04-25T10:33:43.179022+0000","last_active":"2024-04-25T10:33:45.563277+0000","last_peered":"2024-04-25T10:33:45.563277+0000","last_clean":"2024-04-25T10:33:45.563277+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:33:45.563277+0000","last_undegraded":"2024-04-25T10:33:45.563277+0000","last_fullsized":"2024-04-25T10:33:45.563277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564322+0000","last_change":"2024-04-25T10:33:43.186661+0000","last_active":"2024-04-25T10:33:45.564322+0000","last_peered":"2024-04-25T10:33:45.564322+0000","last_clean":"2024-04-25T10:33:45.564322+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:33:45.564322+0000","last_undegraded":"2024-04-25T10:33:45.564322+0000","last_fullsized":"2024-04-25T10:33:45.564322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.758005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063277+0000","last_change":"2024-04-25T10:33:43.175801+0000","last_active":"2024-04-25T10:33:45.063277+0000","last_peered":"2024-04-25T10:33:45.063277+0000","last_clean":"2024-04-25T10:33:45.063277+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:33:45.063277+0000","last_undegraded":"2024-04-25T10:33:45.063277+0000","last_fullsized":"2024-04-25T10:33:45.063277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167037+0000","last_change":"2024-04-25T10:33:43.183056+0000","last_active":"2024-04-25T10:33:44.167037+0000","last_peered":"2024-04-25T10:33:44.167037+0000","last_clean":"2024-04-25T10:33:44.167037+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:33:44.167037+0000","last_undegraded":"2024-04-25T10:33:44.167037+0000","last_fullsized":"2024-04-25T10:33:44.167037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564030+0000","last_change":"2024-04-25T10:33:43.180388+0000","last_active":"2024-04-25T10:33:45.564030+0000","last_peered":"2024-04-25T10:33:45.564030+0000","last_clean":"2024-04-25T10:33:45.564030+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:33:45.564030+0000","last_undegraded":"2024-04-25T10:33:45.564030+0000","last_fullsized":"2024-04-25T10:33:45.564030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167865+0000","last_change":"2024-04-25T10:33:43.162216+0000","last_active":"2024-04-25T10:33:44.167865+0000","last_peered":"2024-04-25T10:33:44.167865+0000","last_clean":"2024-04-25T10:33:44.167865+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:33:44.167865+0000","last_undegraded":"2024-04-25T10:33:44.167865+0000","last_fullsized":"2024-04-25T10:33:44.167865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563722+0000","last_change":"2024-04-25T10:33:43.183734+0000","last_active":"2024-04-25T10:33:45.563722+0000","last_peered":"2024-04-25T10:33:45.563722+0000","last_clean":"2024-04-25T10:33:45.563722+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:33:45.563722+0000","last_undegraded":"2024-04-25T10:33:45.563722+0000","last_fullsized":"2024-04-25T10:33:45.563722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168353+0000","last_change":"2024-04-25T10:33:43.167323+0000","last_active":"2024-04-25T10:33:44.168353+0000","last_peered":"2024-04-25T10:33:44.168353+0000","last_clean":"2024-04-25T10:33:44.168353+0000","last_became_active":"2024-04-25T10:33:43.166975+0000","last_became_peered":"2024-04-25T10:33:43.166975+0000","last_unstale":"2024-04-25T10:33:44.168353+0000","last_undegraded":"2024-04-25T10:33:44.168353+0000","last_fullsized":"2024-04-25T10:33:44.168353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063622+0000","last_change":"2024-04-25T10:33:43.183648+0000","last_active":"2024-04-25T10:33:45.063622+0000","last_peered":"2024-04-25T10:33:45.063622+0000","last_clean":"2024-04-25T10:33:45.063622+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:33:45.063622+0000","last_undegraded":"2024-04-25T10:33:45.063622+0000","last_fullsized":"2024-04-25T10:33:45.063622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065076+0000","last_change":"2024-04-25T10:33:43.175229+0000","last_active":"2024-04-25T10:33:45.065076+0000","last_peered":"2024-04-25T10:33:45.065076+0000","last_clean":"2024-04-25T10:33:45.065076+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:33:45.065076+0000","last_undegraded":"2024-04-25T10:33:45.065076+0000","last_fullsized":"2024-04-25T10:33:45.065076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168339+0000","last_change":"2024-04-25T10:33:43.162579+0000","last_active":"2024-04-25T10:33:44.168339+0000","last_peered":"2024-04-25T10:33:44.168339+0000","last_clean":"2024-04-25T10:33:44.168339+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:33:44.168339+0000","last_undegraded":"2024-04-25T10:33:44.168339+0000","last_fullsized":"2024-04-25T10:33:44.168339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167166+0000","last_change":"2024-04-25T10:33:43.168576+0000","last_active":"2024-04-25T10:33:44.167166+0000","last_peered":"2024-04-25T10:33:44.167166+0000","last_clean":"2024-04-25T10:33:44.167166+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:33:44.167166+0000","last_undegraded":"2024-04-25T10:33:44.167166+0000","last_fullsized":"2024-04-25T10:33:44.167166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564440+0000","last_change":"2024-04-25T10:33:43.182970+0000","last_active":"2024-04-25T10:33:45.564440+0000","last_peered":"2024-04-25T10:33:45.564440+0000","last_clean":"2024-04-25T10:33:45.564440+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:33:45.564440+0000","last_undegraded":"2024-04-25T10:33:45.564440+0000","last_fullsized":"2024-04-25T10:33:45.564440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563073+0000","last_change":"2024-04-25T10:33:43.171456+0000","last_active":"2024-04-25T10:33:45.563073+0000","last_peered":"2024-04-25T10:33:45.563073+0000","last_clean":"2024-04-25T10:33:45.563073+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:33:45.563073+0000","last_undegraded":"2024-04-25T10:33:45.563073+0000","last_fullsized":"2024-04-25T10:33:45.563073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063096+0000","last_change":"2024-04-25T10:33:43.183419+0000","last_active":"2024-04-25T10:33:45.063096+0000","last_peered":"2024-04-25T10:33:45.063096+0000","last_clean":"2024-04-25T10:33:45.063096+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:33:45.063096+0000","last_undegraded":"2024-04-25T10:33:45.063096+0000","last_fullsized":"2024-04-25T10:33:45.063096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168586+0000","last_change":"2024-04-25T10:33:43.170134+0000","last_active":"2024-04-25T10:33:44.168586+0000","last_peered":"2024-04-25T10:33:44.168586+0000","last_clean":"2024-04-25T10:33:44.168586+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:33:44.168586+0000","last_undegraded":"2024-04-25T10:33:44.168586+0000","last_fullsized":"2024-04-25T10:33:44.168586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:06.463548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168273+0000","last_change":"2024-04-25T10:33:42.162138+0000","last_active":"2024-04-25T10:33:44.168273+0000","last_peered":"2024-04-25T10:33:44.168273+0000","last_clean":"2024-04-25T10:33:44.168273+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:33:44.168273+0000","last_undegraded":"2024-04-25T10:33:44.168273+0000","last_fullsized":"2024-04-25T10:33:44.168273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167155+0000","last_change":"2024-04-25T10:33:43.172141+0000","last_active":"2024-04-25T10:33:44.167155+0000","last_peered":"2024-04-25T10:33:44.167155+0000","last_clean":"2024-04-25T10:33:44.167155+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:33:44.167155+0000","last_undegraded":"2024-04-25T10:33:44.167155+0000","last_fullsized":"2024-04-25T10:33:44.167155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063005+0000","last_change":"2024-04-25T10:33:42.161614+0000","last_active":"2024-04-25T10:33:45.063005+0000","last_peered":"2024-04-25T10:33:45.063005+0000","last_clean":"2024-04-25T10:33:45.063005+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:33:45.063005+0000","last_undegraded":"2024-04-25T10:33:45.063005+0000","last_fullsized":"2024-04-25T10:33:45.063005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167835+0000","last_change":"2024-04-25T10:33:42.158934+0000","last_active":"2024-04-25T10:33:44.167835+0000","last_peered":"2024-04-25T10:33:44.167835+0000","last_clean":"2024-04-25T10:33:44.167835+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:33:44.167835+0000","last_undegraded":"2024-04-25T10:33:44.167835+0000","last_fullsized":"2024-04-25T10:33:44.167835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168337+0000","last_change":"2024-04-25T10:33:43.170270+0000","last_active":"2024-04-25T10:33:44.168337+0000","last_peered":"2024-04-25T10:33:44.168337+0000","last_clean":"2024-04-25T10:33:44.168337+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:33:44.168337+0000","last_undegraded":"2024-04-25T10:33:44.168337+0000","last_fullsized":"2024-04-25T10:33:44.168337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563940+0000","last_change":"2024-04-25T10:33:42.162167+0000","last_active":"2024-04-25T10:33:45.563940+0000","last_peered":"2024-04-25T10:33:45.563940+0000","last_clean":"2024-04-25T10:33:45.563940+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:33:45.563940+0000","last_undegraded":"2024-04-25T10:33:45.563940+0000","last_fullsized":"2024-04-25T10:33:45.563940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064954+0000","last_change":"2024-04-25T10:33:43.174366+0000","last_active":"2024-04-25T10:33:45.064954+0000","last_peered":"2024-04-25T10:33:45.064954+0000","last_clean":"2024-04-25T10:33:45.064954+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:33:45.064954+0000","last_undegraded":"2024-04-25T10:33:45.064954+0000","last_fullsized":"2024-04-25T10:33:45.064954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063378+0000","last_change":"2024-04-25T10:33:42.163161+0000","last_active":"2024-04-25T10:33:45.063378+0000","last_peered":"2024-04-25T10:33:45.063378+0000","last_clean":"2024-04-25T10:33:45.063378+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:33:45.063378+0000","last_undegraded":"2024-04-25T10:33:45.063378+0000","last_fullsized":"2024-04-25T10:33:45.063378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563968+0000","last_change":"2024-04-25T10:33:43.179159+0000","last_active":"2024-04-25T10:33:45.563968+0000","last_peered":"2024-04-25T10:33:45.563968+0000","last_clean":"2024-04-25T10:33:45.563968+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:33:45.563968+0000","last_undegraded":"2024-04-25T10:33:45.563968+0000","last_fullsized":"2024-04-25T10:33:45.563968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564180+0000","last_change":"2024-04-25T10:33:42.168608+0000","last_active":"2024-04-25T10:33:45.564180+0000","last_peered":"2024-04-25T10:33:45.564180+0000","last_clean":"2024-04-25T10:33:45.564180+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:33:45.564180+0000","last_undegraded":"2024-04-25T10:33:45.564180+0000","last_fullsized":"2024-04-25T10:33:45.564180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167316+0000","last_change":"2024-04-25T10:33:43.172553+0000","last_active":"2024-04-25T10:33:44.167316+0000","last_peered":"2024-04-25T10:33:44.167316+0000","last_clean":"2024-04-25T10:33:44.167316+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:33:44.167316+0000","last_undegraded":"2024-04-25T10:33:44.167316+0000","last_fullsized":"2024-04-25T10:33:44.167316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065060+0000","last_change":"2024-04-25T10:33:42.160656+0000","last_active":"2024-04-25T10:33:45.065060+0000","last_peered":"2024-04-25T10:33:45.065060+0000","last_clean":"2024-04-25T10:33:45.065060+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:33:45.065060+0000","last_undegraded":"2024-04-25T10:33:45.065060+0000","last_fullsized":"2024-04-25T10:33:45.065060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:16.669213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168940+0000","last_change":"2024-04-25T10:33:43.178426+0000","last_active":"2024-04-25T10:33:44.168940+0000","last_peered":"2024-04-25T10:33:44.168940+0000","last_clean":"2024-04-25T10:33:44.168940+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:33:44.168940+0000","last_undegraded":"2024-04-25T10:33:44.168940+0000","last_fullsized":"2024-04-25T10:33:44.168940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063183+0000","last_change":"2024-04-25T10:33:42.160251+0000","last_active":"2024-04-25T10:33:45.063183+0000","last_peered":"2024-04-25T10:33:45.063183+0000","last_clean":"2024-04-25T10:33:45.063183+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:33:45.063183+0000","last_undegraded":"2024-04-25T10:33:45.063183+0000","last_fullsized":"2024-04-25T10:33:45.063183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563799+0000","last_change":"2024-04-25T10:33:43.180666+0000","last_active":"2024-04-25T10:33:45.563799+0000","last_peered":"2024-04-25T10:33:45.563799+0000","last_clean":"2024-04-25T10:33:45.563799+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:33:45.563799+0000","last_undegraded":"2024-04-25T10:33:45.563799+0000","last_fullsized":"2024-04-25T10:33:45.563799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167270+0000","last_change":"2024-04-25T10:33:42.164005+0000","last_active":"2024-04-25T10:33:44.167270+0000","last_peered":"2024-04-25T10:33:44.167270+0000","last_clean":"2024-04-25T10:33:44.167270+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:33:44.167270+0000","last_undegraded":"2024-04-25T10:33:44.167270+0000","last_fullsized":"2024-04-25T10:33:44.167270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:54.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166893+0000","last_change":"2024-04-25T10:33:43.181483+0000","last_active":"2024-04-25T10:33:44.166893+0000","last_peered":"2024-04-25T10:33:44.166893+0000","last_clean":"2024-04-25T10:33:44.166893+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:33:44.166893+0000","last_undegraded":"2024-04-25T10:33:44.166893+0000","last_fullsized":"2024-04-25T10:33:44.166893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:42.713890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564604+0000","last_change":"2024-04-25T10:33:42.163146+0000","last_active":"2024-04-25T10:33:45.564604+0000","last_peered":"2024-04-25T10:33:45.564604+0000","last_clean":"2024-04-25T10:33:45.564604+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:33:45.564604+0000","last_undegraded":"2024-04-25T10:33:45.564604+0000","last_fullsized":"2024-04-25T10:33:45.564604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564706+0000","last_change":"2024-04-25T10:33:43.183314+0000","last_active":"2024-04-25T10:33:45.564706+0000","last_peered":"2024-04-25T10:33:45.564706+0000","last_clean":"2024-04-25T10:33:45.564706+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:33:45.564706+0000","last_undegraded":"2024-04-25T10:33:45.564706+0000","last_fullsized":"2024-04-25T10:33:45.564706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:07.841471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.062968+0000","last_change":"2024-04-25T10:33:42.166542+0000","last_active":"2024-04-25T10:33:45.062968+0000","last_peered":"2024-04-25T10:33:45.062968+0000","last_clean":"2024-04-25T10:33:45.062968+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:33:45.062968+0000","last_undegraded":"2024-04-25T10:33:45.062968+0000","last_fullsized":"2024-04-25T10:33:45.062968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063134+0000","last_change":"2024-04-25T10:33:43.176217+0000","last_active":"2024-04-25T10:33:45.063134+0000","last_peered":"2024-04-25T10:33:45.063134+0000","last_clean":"2024-04-25T10:33:45.063134+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:33:45.063134+0000","last_undegraded":"2024-04-25T10:33:45.063134+0000","last_fullsized":"2024-04-25T10:33:45.063134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.562984+0000","last_change":"2024-04-25T10:33:42.156163+0000","last_active":"2024-04-25T10:33:45.562984+0000","last_peered":"2024-04-25T10:33:45.562984+0000","last_clean":"2024-04-25T10:33:45.562984+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:33:45.562984+0000","last_undegraded":"2024-04-25T10:33:45.562984+0000","last_fullsized":"2024-04-25T10:33:45.562984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563910+0000","last_change":"2024-04-25T10:33:43.183091+0000","last_active":"2024-04-25T10:33:45.563910+0000","last_peered":"2024-04-25T10:33:45.563910+0000","last_clean":"2024-04-25T10:33:45.563910+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:33:45.563910+0000","last_undegraded":"2024-04-25T10:33:45.563910+0000","last_fullsized":"2024-04-25T10:33:45.563910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.169208+0000","last_change":"2024-04-25T10:33:42.162393+0000","last_active":"2024-04-25T10:33:44.169208+0000","last_peered":"2024-04-25T10:33:44.169208+0000","last_clean":"2024-04-25T10:33:44.169208+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:33:44.169208+0000","last_undegraded":"2024-04-25T10:33:44.169208+0000","last_fullsized":"2024-04-25T10:33:44.169208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:57.969551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564904+0000","last_change":"2024-04-25T10:33:43.183207+0000","last_active":"2024-04-25T10:33:45.564904+0000","last_peered":"2024-04-25T10:33:45.564904+0000","last_clean":"2024-04-25T10:33:45.564904+0000","last_became_active":"2024-04-25T10:33:43.182885+0000","last_became_peered":"2024-04-25T10:33:43.182885+0000","last_unstale":"2024-04-25T10:33:45.564904+0000","last_undegraded":"2024-04-25T10:33:45.564904+0000","last_fullsized":"2024-04-25T10:33:45.564904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:25.864847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563260+0000","last_change":"2024-04-25T10:33:42.159468+0000","last_active":"2024-04-25T10:33:45.563260+0000","last_peered":"2024-04-25T10:33:45.563260+0000","last_clean":"2024-04-25T10:33:45.563260+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:33:45.563260+0000","last_undegraded":"2024-04-25T10:33:45.563260+0000","last_fullsized":"2024-04-25T10:33:45.563260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.565181+0000","last_change":"2024-04-25T10:33:43.181841+0000","last_active":"2024-04-25T10:33:45.565181+0000","last_peered":"2024-04-25T10:33:45.565181+0000","last_clean":"2024-04-25T10:33:45.565181+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:33:45.565181+0000","last_undegraded":"2024-04-25T10:33:45.565181+0000","last_fullsized":"2024-04-25T10:33:45.565181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:37.937673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065207+0000","last_change":"2024-04-25T10:33:42.152094+0000","last_active":"2024-04-25T10:33:45.065207+0000","last_peered":"2024-04-25T10:33:45.065207+0000","last_clean":"2024-04-25T10:33:45.065207+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:33:45.065207+0000","last_undegraded":"2024-04-25T10:33:45.065207+0000","last_fullsized":"2024-04-25T10:33:45.065207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.924435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564432+0000","last_change":"2024-04-25T10:33:43.177222+0000","last_active":"2024-04-25T10:33:45.564432+0000","last_peered":"2024-04-25T10:33:45.564432+0000","last_clean":"2024-04-25T10:33:45.564432+0000","last_became_active":"2024-04-25T10:33:43.173582+0000","last_became_peered":"2024-04-25T10:33:43.173582+0000","last_unstale":"2024-04-25T10:33:45.564432+0000","last_undegraded":"2024-04-25T10:33:45.564432+0000","last_fullsized":"2024-04-25T10:33:45.564432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:21.953612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563175+0000","last_change":"2024-04-25T10:33:42.167140+0000","last_active":"2024-04-25T10:33:45.563175+0000","last_peered":"2024-04-25T10:33:45.563175+0000","last_clean":"2024-04-25T10:33:45.563175+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:33:45.563175+0000","last_undegraded":"2024-04-25T10:33:45.563175+0000","last_fullsized":"2024-04-25T10:33:45.563175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564021+0000","last_change":"2024-04-25T10:33:43.184750+0000","last_active":"2024-04-25T10:33:45.564021+0000","last_peered":"2024-04-25T10:33:45.564021+0000","last_clean":"2024-04-25T10:33:45.564021+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:33:45.564021+0000","last_undegraded":"2024-04-25T10:33:45.564021+0000","last_fullsized":"2024-04-25T10:33:45.564021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":110,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563599+0000","last_change":"2024-04-25T10:33:31.708843+0000","last_active":"2024-04-25T10:33:45.563599+0000","last_peered":"2024-04-25T10:33:45.563599+0000","last_clean":"2024-04-25T10:33:45.563599+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:33:45.563599+0000","last_undegraded":"2024-04-25T10:33:45.563599+0000","last_fullsized":"2024-04-25T10:33:45.563599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_clean_scrub_stamp":"2024-04-25T10:33:30.626866+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:10.475782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563669+0000","last_change":"2024-04-25T10:33:42.164505+0000","last_active":"2024-04-25T10:33:45.563669+0000","last_peered":"2024-04-25T10:33:45.563669+0000","last_clean":"2024-04-25T10:33:45.563669+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:33:45.563669+0000","last_undegraded":"2024-04-25T10:33:45.563669+0000","last_fullsized":"2024-04-25T10:33:45.563669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167927+0000","last_change":"2024-04-25T10:33:43.169958+0000","last_active":"2024-04-25T10:33:44.167927+0000","last_peered":"2024-04-25T10:33:44.167927+0000","last_clean":"2024-04-25T10:33:44.167927+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:33:44.167927+0000","last_undegraded":"2024-04-25T10:33:44.167927+0000","last_fullsized":"2024-04-25T10:33:44.167927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563434+0000","last_change":"2024-04-25T10:33:42.163852+0000","last_active":"2024-04-25T10:33:45.563434+0000","last_peered":"2024-04-25T10:33:45.563434+0000","last_clean":"2024-04-25T10:33:45.563434+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:33:45.563434+0000","last_undegraded":"2024-04-25T10:33:45.563434+0000","last_fullsized":"2024-04-25T10:33:45.563434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:28.602376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.166780+0000","last_change":"2024-04-25T10:33:43.165039+0000","last_active":"2024-04-25T10:33:44.166780+0000","last_peered":"2024-04-25T10:33:44.166780+0000","last_clean":"2024-04-25T10:33:44.166780+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:33:44.166780+0000","last_undegraded":"2024-04-25T10:33:44.166780+0000","last_fullsized":"2024-04-25T10:33:44.166780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:30.822807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563144+0000","last_change":"2024-04-25T10:33:42.160012+0000","last_active":"2024-04-25T10:33:45.563144+0000","last_peered":"2024-04-25T10:33:45.563144+0000","last_clean":"2024-04-25T10:33:45.563144+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:33:45.563144+0000","last_undegraded":"2024-04-25T10:33:45.563144+0000","last_fullsized":"2024-04-25T10:33:45.563144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.064963+0000","last_change":"2024-04-25T10:33:43.170473+0000","last_active":"2024-04-25T10:33:45.064963+0000","last_peered":"2024-04-25T10:33:45.064963+0000","last_clean":"2024-04-25T10:33:45.064963+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:33:45.064963+0000","last_undegraded":"2024-04-25T10:33:45.064963+0000","last_fullsized":"2024-04-25T10:33:45.064963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564704+0000","last_change":"2024-04-25T10:33:42.161197+0000","last_active":"2024-04-25T10:33:45.564704+0000","last_peered":"2024-04-25T10:33:45.564704+0000","last_clean":"2024-04-25T10:33:45.564704+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:33:45.564704+0000","last_undegraded":"2024-04-25T10:33:45.564704+0000","last_fullsized":"2024-04-25T10:33:45.564704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168672+0000","last_change":"2024-04-25T10:33:43.172447+0000","last_active":"2024-04-25T10:33:44.168672+0000","last_peered":"2024-04-25T10:33:44.168672+0000","last_clean":"2024-04-25T10:33:44.168672+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:33:44.168672+0000","last_undegraded":"2024-04-25T10:33:44.168672+0000","last_fullsized":"2024-04-25T10:33:44.168672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:19.195134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065155+0000","last_change":"2024-04-25T10:33:42.161100+0000","last_active":"2024-04-25T10:33:45.065155+0000","last_peered":"2024-04-25T10:33:45.065155+0000","last_clean":"2024-04-25T10:33:45.065155+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:33:45.065155+0000","last_undegraded":"2024-04-25T10:33:45.065155+0000","last_fullsized":"2024-04-25T10:33:45.065155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564491+0000","last_change":"2024-04-25T10:33:43.175361+0000","last_active":"2024-04-25T10:33:45.564491+0000","last_peered":"2024-04-25T10:33:45.564491+0000","last_clean":"2024-04-25T10:33:45.564491+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:33:45.564491+0000","last_undegraded":"2024-04-25T10:33:45.564491+0000","last_fullsized":"2024-04-25T10:33:45.564491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564430+0000","last_change":"2024-04-25T10:33:42.170292+0000","last_active":"2024-04-25T10:33:45.564430+0000","last_peered":"2024-04-25T10:33:45.564430+0000","last_clean":"2024-04-25T10:33:45.564430+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:33:45.564430+0000","last_undegraded":"2024-04-25T10:33:45.564430+0000","last_fullsized":"2024-04-25T10:33:45.564430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:47.392698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065123+0000","last_change":"2024-04-25T10:33:43.170285+0000","last_active":"2024-04-25T10:33:45.065123+0000","last_peered":"2024-04-25T10:33:45.065123+0000","last_clean":"2024-04-25T10:33:45.065123+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:33:45.065123+0000","last_undegraded":"2024-04-25T10:33:45.065123+0000","last_fullsized":"2024-04-25T10:33:45.065123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.170514+0000","last_change":"2024-04-25T10:33:42.160069+0000","last_active":"2024-04-25T10:33:45.170514+0000","last_peered":"2024-04-25T10:33:45.170514+0000","last_clean":"2024-04-25T10:33:45.170514+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:33:45.170514+0000","last_undegraded":"2024-04-25T10:33:45.170514+0000","last_fullsized":"2024-04-25T10:33:45.170514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168242+0000","last_change":"2024-04-25T10:33:43.181641+0000","last_active":"2024-04-25T10:33:44.168242+0000","last_peered":"2024-04-25T10:33:44.168242+0000","last_clean":"2024-04-25T10:33:44.168242+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:33:44.168242+0000","last_undegraded":"2024-04-25T10:33:44.168242+0000","last_fullsized":"2024-04-25T10:33:44.168242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063445+0000","last_change":"2024-04-25T10:33:42.165706+0000","last_active":"2024-04-25T10:33:45.063445+0000","last_peered":"2024-04-25T10:33:45.063445+0000","last_clean":"2024-04-25T10:33:45.063445+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:33:45.063445+0000","last_undegraded":"2024-04-25T10:33:45.063445+0000","last_fullsized":"2024-04-25T10:33:45.063445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167085+0000","last_change":"2024-04-25T10:33:43.173260+0000","last_active":"2024-04-25T10:33:44.167085+0000","last_peered":"2024-04-25T10:33:44.167085+0000","last_clean":"2024-04-25T10:33:44.167085+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:33:44.167085+0000","last_undegraded":"2024-04-25T10:33:44.167085+0000","last_fullsized":"2024-04-25T10:33:44.167085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563434+0000","last_change":"2024-04-25T10:33:42.166946+0000","last_active":"2024-04-25T10:33:45.563434+0000","last_peered":"2024-04-25T10:33:45.563434+0000","last_clean":"2024-04-25T10:33:45.563434+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:33:45.563434+0000","last_undegraded":"2024-04-25T10:33:45.563434+0000","last_fullsized":"2024-04-25T10:33:45.563434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:29.817932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168855+0000","last_change":"2024-04-25T10:33:43.170510+0000","last_active":"2024-04-25T10:33:44.168855+0000","last_peered":"2024-04-25T10:33:44.168855+0000","last_clean":"2024-04-25T10:33:44.168855+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:33:44.168855+0000","last_undegraded":"2024-04-25T10:33:44.168855+0000","last_fullsized":"2024-04-25T10:33:44.168855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065073+0000","last_change":"2024-04-25T10:33:42.165204+0000","last_active":"2024-04-25T10:33:45.065073+0000","last_peered":"2024-04-25T10:33:45.065073+0000","last_clean":"2024-04-25T10:33:45.065073+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:33:45.065073+0000","last_undegraded":"2024-04-25T10:33:45.065073+0000","last_fullsized":"2024-04-25T10:33:45.065073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167946+0000","last_change":"2024-04-25T10:33:43.168088+0000","last_active":"2024-04-25T10:33:44.167946+0000","last_peered":"2024-04-25T10:33:44.167946+0000","last_clean":"2024-04-25T10:33:44.167946+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:33:44.167946+0000","last_undegraded":"2024-04-25T10:33:44.167946+0000","last_fullsized":"2024-04-25T10:33:44.167946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.065140+0000","last_change":"2024-04-25T10:33:42.156381+0000","last_active":"2024-04-25T10:33:45.065140+0000","last_peered":"2024-04-25T10:33:45.065140+0000","last_clean":"2024-04-25T10:33:45.065140+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:33:45.065140+0000","last_undegraded":"2024-04-25T10:33:45.065140+0000","last_fullsized":"2024-04-25T10:33:45.065140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168277+0000","last_change":"2024-04-25T10:33:43.167502+0000","last_active":"2024-04-25T10:33:44.168277+0000","last_peered":"2024-04-25T10:33:44.168277+0000","last_clean":"2024-04-25T10:33:44.168277+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:33:44.168277+0000","last_undegraded":"2024-04-25T10:33:44.168277+0000","last_fullsized":"2024-04-25T10:33:44.168277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564856+0000","last_change":"2024-04-25T10:33:42.168840+0000","last_active":"2024-04-25T10:33:45.564856+0000","last_peered":"2024-04-25T10:33:45.564856+0000","last_clean":"2024-04-25T10:33:45.564856+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:33:45.564856+0000","last_undegraded":"2024-04-25T10:33:45.564856+0000","last_fullsized":"2024-04-25T10:33:45.564856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:51.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.063081+0000","last_change":"2024-04-25T10:33:43.174672+0000","last_active":"2024-04-25T10:33:45.063081+0000","last_peered":"2024-04-25T10:33:45.063081+0000","last_clean":"2024-04-25T10:33:45.063081+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:33:45.063081+0000","last_undegraded":"2024-04-25T10:33:45.063081+0000","last_fullsized":"2024-04-25T10:33:45.063081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564265+0000","last_change":"2024-04-25T10:33:43.179274+0000","last_active":"2024-04-25T10:33:45.564265+0000","last_peered":"2024-04-25T10:33:45.564265+0000","last_clean":"2024-04-25T10:33:45.564265+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:33:45.564265+0000","last_undegraded":"2024-04-25T10:33:45.564265+0000","last_fullsized":"2024-04-25T10:33:45.564265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:24.341521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.563786+0000","last_change":"2024-04-25T10:33:42.168654+0000","last_active":"2024-04-25T10:33:45.563786+0000","last_peered":"2024-04-25T10:33:45.563786+0000","last_clean":"2024-04-25T10:33:45.563786+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:33:45.563786+0000","last_undegraded":"2024-04-25T10:33:45.563786+0000","last_fullsized":"2024-04-25T10:33:45.563786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:15.158541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564077+0000","last_change":"2024-04-25T10:33:43.170923+0000","last_active":"2024-04-25T10:33:45.564077+0000","last_peered":"2024-04-25T10:33:45.564077+0000","last_clean":"2024-04-25T10:33:45.564077+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:33:45.564077+0000","last_undegraded":"2024-04-25T10:33:45.564077+0000","last_fullsized":"2024-04-25T10:33:45.564077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:45.564130+0000","last_change":"2024-04-25T10:33:42.171374+0000","last_active":"2024-04-25T10:33:45.564130+0000","last_peered":"2024-04-25T10:33:45.564130+0000","last_clean":"2024-04-25T10:33:45.564130+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:33:45.564130+0000","last_undegraded":"2024-04-25T10:33:45.564130+0000","last_fullsized":"2024-04-25T10:33:45.564130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:41.709015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167209+0000","last_change":"2024-04-25T10:33:43.172788+0000","last_active":"2024-04-25T10:33:44.167209+0000","last_peered":"2024-04-25T10:33:44.167209+0000","last_clean":"2024-04-25T10:33:44.167209+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:33:44.167209+0000","last_undegraded":"2024-04-25T10:33:44.167209+0000","last_fullsized":"2024-04-25T10:33:44.167209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168142+0000","last_change":"2024-04-25T10:33:42.161364+0000","last_active":"2024-04-25T10:33:44.168142+0000","last_peered":"2024-04-25T10:33:44.168142+0000","last_clean":"2024-04-25T10:33:44.168142+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:33:44.168142+0000","last_undegraded":"2024-04-25T10:33:44.168142+0000","last_fullsized":"2024-04-25T10:33:44.168142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.168175+0000","last_change":"2024-04-25T10:33:43.177654+0000","last_active":"2024-04-25T10:33:44.168175+0000","last_peered":"2024-04-25T10:33:44.168175+0000","last_clean":"2024-04-25T10:33:44.168175+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:33:44.168175+0000","last_undegraded":"2024-04-25T10:33:44.168175+0000","last_fullsized":"2024-04-25T10:33:44.168175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T10:33:44.167339+0000","last_change":"2024-04-25T10:33:42.167156+0000","last_active":"2024-04-25T10:33:44.167339+0000","last_peered":"2024-04-25T10:33:44.167339+0000","last_clean":"2024-04-25T10:33:44.167339+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:33:44.167339+0000","last_undegraded":"2024-04-25T10:33:44.167339+0000","last_fullsized":"2024-04-25T10:33:44.167339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:33:51.046 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T10:33:51.047 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T10:33:51.047 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T10:33:51.047 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:33:51.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.191+0000 7f8c2466e640 1 Processor -- start 2024-04-25T10:33:51.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.191+0000 7f8c2466e640 1 -- start start 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c2466e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c1c0be4c0 0x7f8c1c0bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c2466e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c1c06d2d0 0x7f8c1c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c2466e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c1c0bda00 con 0x7f8c1c143960 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c2466e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8c1c0be030 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c2466e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f8c1c0bdcc0 con 0x7f8c1c06d2d0 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c21c09640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c1c0be4c0 0x7f8c1c0bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c2240a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8c1c143960 0x7f8c1c149480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33172/0 (socket says 172.21.15.103:33172) 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c21c09640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8c1c0be4c0 0x7f8c1c0bbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49086/0 (socket says 172.21.15.103:49086) 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.192+0000 7f8c2240a640 1 -- 172.21.15.103:0/1356505672 learned_addr learned my addr 172.21.15.103:0/1356505672 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.193+0000 7f8c22c0b640 1 --2- 172.21.15.103:0/1356505672 >> v2:172.21.15.132:3300/0 conn(0x7f8c1c06d2d0 0x7f8c1c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.193+0000 7f8c21c09640 1 -- 172.21.15.103:0/1356505672 >> v2:172.21.15.132:3300/0 conn(0x7f8c1c06d2d0 msgr2=0x7f8c1c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.193+0000 7f8c21c09640 1 --2- 172.21.15.103:0/1356505672 >> v2:172.21.15.132:3300/0 conn(0x7f8c1c06d2d0 0x7f8c1c06d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.193+0000 7f8c21c09640 1 -- 172.21.15.103:0/1356505672 >> v1:172.21.15.103:6789/0 conn(0x7f8c1c143960 legacy=0x7f8c1c149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.193+0000 7f8c21c09640 1 -- 172.21.15.103:0/1356505672 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c06dc20 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.193+0000 7f8c21408640 1 -- 172.21.15.103:0/1356505672 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179129497 0 0) 0x7f8c1c0bda00 con 0x7f8c1c143960 2024-04-25T10:33:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.193+0000 7f8c21c09640 1 --2- 172.21.15.103:0/1356505672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c0bbb00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c143da0 tx=0x7f8c0c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70739bbdaa55166 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c21408640 1 -- 172.21.15.103:0/1356505672 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037070 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c21408640 1 -- 172.21.15.103:0/1356505672 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c032440 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c21408640 1 -- 172.21.15.103:0/1356505672 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c02ae60 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c2466e640 1 -- 172.21.15.103:0/1356505672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 msgr2=0x7f8c1c0bbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1356505672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c0bbb00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c143da0 tx=0x7f8c0c02a110 comp rx=0 tx=0).stop 2024-04-25T10:33:51.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c2466e640 1 -- 172.21.15.103:0/1356505672 shutdown_connections 2024-04-25T10:33:51.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1356505672 >> v2:172.21.15.132:3300/0 conn(0x7f8c1c06d2d0 0x7f8c1c06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1356505672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c0bbb00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c2466e640 1 -- 172.21.15.103:0/1356505672 >> 172.21.15.103:0/1356505672 conn(0x7f8c1c0befa0 msgr2=0x7f8c1c0bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:51.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c2466e640 1 -- 172.21.15.103:0/1356505672 shutdown_connections 2024-04-25T10:33:51.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.194+0000 7f8c2466e640 1 -- 172.21.15.103:0/1356505672 wait complete. 2024-04-25T10:33:51.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.196+0000 7f8c2466e640 1 Processor -- start 2024-04-25T10:33:51.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.196+0000 7f8c2466e640 1 -- start start 2024-04-25T10:33:51.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c2466e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c1c06d2d0 0x7f8c1c1df600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c2466e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c1451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c2466e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c1c143960 0x7f8c1c139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c2466e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c153f20 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c2466e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1c153da0 con 0x7f8c1c143960 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c2466e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1c1540a0 con 0x7f8c1c06d2d0 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c1451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c1451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49090/0 (socket says 172.21.15.103:49090) 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 -- 172.21.15.103:0/1707027969 learned_addr learned my addr 172.21.15.103:0/1707027969 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c2240a640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c1c06d2d0 0x7f8c1c1df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c22c0b640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c1c143960 0x7f8c1c139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 -- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c1c06d2d0 msgr2=0x7f8c1c1df600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c1c06d2d0 0x7f8c1c1df600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 -- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c1c143960 msgr2=0x7f8c1c139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c1c143960 0x7f8c1c139a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 -- 172.21.15.103:0/1707027969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c1c146e70 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c2240a640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c1c06d2d0 0x7f8c1c1df600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c22c0b640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c1c143960 0x7f8c1c139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c21c09640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c1451a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c035040 tx=0x7f8c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.197+0000 7f8c12ffd640 1 -- 172.21.15.103:0/1707027969 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037050 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.198+0000 7f8c12ffd640 1 -- 172.21.15.103:0/1707027969 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c038040 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.198+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1c1441d0 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.198+0000 7f8c12ffd640 1 -- 172.21.15.103:0/1707027969 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c004470 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.198+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1c1dfdc0 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.199+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1c06a130 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.199+0000 7f8c12ffd640 1 -- 172.21.15.103:0/1707027969 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8c0c030980 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.200+0000 7f8c12ffd640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8c000744e0 0x7f8c000769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.200+0000 7f8c12ffd640 1 -- 172.21.15.103:0/1707027969 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c0c0b5d80 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.200+0000 7f8c2240a640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8c000744e0 0x7f8c000769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.200+0000 7f8c2240a640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8c000744e0 0x7f8c000769f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000f60 tx=0x7f8c18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.204+0000 7f8c12ffd640 1 -- 172.21.15.103:0/1707027969 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c1c146e70 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.421+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8c1c153b80 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.421+0000 7f8c12ffd640 1 -- 172.21.15.103:0/1707027969 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8c0c0805a0 con 0x7f8c1c0be4c0 2024-04-25T10:33:51.423 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:51.423 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:33:51.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8c000744e0 msgr2=0x7f8c000769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8c000744e0 0x7f8c000769f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c18000f60 tx=0x7f8c18009040 comp rx=0 tx=0).stop 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 msgr2=0x7f8c1c1451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c1451a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c035040 tx=0x7f8c0c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 shutdown_connections 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f8c000744e0 0x7f8c000769f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c1c143960 0x7f8c1c139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8c1c0be4c0 0x7f8c1c1451a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 --2- 172.21.15.103:0/1707027969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c1c06d2d0 0x7f8c1c1df600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 >> 172.21.15.103:0/1707027969 conn(0x7f8c1c0befa0 msgr2=0x7f8c1c0baaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 shutdown_connections 2024-04-25T10:33:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.423+0000 7f8c2466e640 1 -- 172.21.15.103:0/1707027969 wait complete. 2024-04-25T10:33:51.435 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T10:33:51.436 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:51.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.542+0000 7feff8614640 1 Processor -- start 2024-04-25T10:33:51.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.542+0000 7feff8614640 1 -- start start 2024-04-25T10:33:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.543+0000 7feff8614640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feff00720e0 0x7feff00b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.543+0000 7feff8614640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feff00b84e0 0x7feff00b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.543+0000 7feff8614640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff00b27c0 con 0x7feff00b23b0 2024-04-25T10:33:51.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.543+0000 7feff8614640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7feff0071970 con 0x7feff00720e0 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.543+0000 7feff8614640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7feff00b2a80 con 0x7feff00b84e0 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.543+0000 7feff5baf640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7feff00b23b0 0x7feff01472a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33176/0 (socket says 172.21.15.103:33176) 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.543+0000 7feff5baf640 1 -- 172.21.15.103:0/4292447701 learned_addr learned my addr 172.21.15.103:0/4292447701 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff63b0640 1 --2- 172.21.15.103:0/4292447701 >> v2:172.21.15.132:3300/0 conn(0x7feff00720e0 0x7feff00b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff6bb1640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feff00b84e0 0x7feff00b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819525755 0 0) 0x7feff00b27c0 con 0x7feff00b23b0 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefdc003520 con 0x7feff00b23b0 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4178698301 0 0) 0x7fefdc003520 con 0x7feff00b23b0 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feff00b84e0 msgr2=0x7feff00b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feff00b84e0 0x7feff00b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 >> v2:172.21.15.132:3300/0 conn(0x7feff00720e0 msgr2=0x7feff00b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 --2- 172.21.15.103:0/4292447701 >> v2:172.21.15.132:3300/0 conn(0x7feff00720e0 0x7feff00b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff0071bc0 con 0x7feff00b23b0 2024-04-25T10:33:51.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fefe0001670 con 0x7feff00b23b0 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 >> v1:172.21.15.103:6789/0 conn(0x7feff00b23b0 legacy=0x7feff01472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feff00b84e0 0x7fefdc0039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefdc003f50 0x7fefdc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefdc004d40 0x7fefdc005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feff0071970 con 0x7fefdc004d40 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7feff00b2a80 con 0x7fefdc003f50 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fefdc00baf0 con 0x7feff00b84e0 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff63b0640 1 --2- 172.21.15.103:0/4292447701 >> v2:172.21.15.132:3300/0 conn(0x7feff00720e0 0x7feff00b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff6bb1640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefdc004d40 0x7fefdc005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff5baf640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefdc003f50 0x7fefdc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff63b0640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feff00b84e0 0x7fefdc0039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff6bb1640 1 -- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feff00b84e0 msgr2=0x7fefdc0039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff6bb1640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feff00b84e0 0x7fefdc0039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff6bb1640 1 -- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefdc003f50 msgr2=0x7fefdc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.544+0000 7feff6bb1640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefdc003f50 0x7fefdc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.545+0000 7feff6bb1640 1 -- 172.21.15.103:0/4292447701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefdc003520 con 0x7fefdc004d40 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.545+0000 7feff6bb1640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefdc004d40 0x7fefdc005150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009fc0 tx=0x7fefdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e714c18c6db7b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.545+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8034020 con 0x7fefdc004d40 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.545+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe80305f0 con 0x7fefdc004d40 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.545+0000 7feff53ae640 1 -- 172.21.15.103:0/4292447701 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8009c10 con 0x7fefdc004d40 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.546+0000 7feff8614640 1 -- 172.21.15.103:0/4292447701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefdc004d40 msgr2=0x7fefdc005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.546+0000 7feff8614640 1 --2- 172.21.15.103:0/4292447701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefdc004d40 0x7fefdc005150 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009fc0 tx=0x7fefdc005830 comp rx=0 tx=0).stop 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.546+0000 7feff6bb1640 1 -- 172.21.15.103:0/4292447701 reap_dead start 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.546+0000 7feff8614640 1 -- 172.21.15.103:0/4292447701 shutdown_connections 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.546+0000 7feff8614640 1 -- 172.21.15.103:0/4292447701 >> 172.21.15.103:0/4292447701 conn(0x7feff00b93f0 msgr2=0x7feff00b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.546+0000 7feff8614640 1 -- 172.21.15.103:0/4292447701 shutdown_connections 2024-04-25T10:33:51.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.546+0000 7feff8614640 1 -- 172.21.15.103:0/4292447701 wait complete. 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.548+0000 7feff8614640 1 Processor -- start 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.548+0000 7feff8614640 1 -- start start 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff8614640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fefdc004d40 0x7feff01d1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff8614640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feff01d2bb0 0x7feff01443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff8614640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feff0144910 0x7feff01dd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff8614640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feff00b6120 con 0x7feff0144910 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff8614640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7feff00b5fa0 con 0x7feff01d2bb0 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff8614640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7feff00b62a0 con 0x7fefdc004d40 2024-04-25T10:33:51.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feff0144910 0x7feff01dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feff0144910 0x7feff01dd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49100/0 (socket says 172.21.15.103:49100) 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 -- 172.21.15.103:0/2355818264 learned_addr learned my addr 172.21.15.103:0/2355818264 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff63b0640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fefdc004d40 0x7feff01d1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff5baf640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feff01d2bb0 0x7feff01443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 -- 172.21.15.103:0/2355818264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fefdc004d40 msgr2=0x7feff01d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fefdc004d40 0x7feff01d1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 -- 172.21.15.103:0/2355818264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feff01d2bb0 msgr2=0x7feff01443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feff01d2bb0 0x7feff01443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 -- 172.21.15.103:0/2355818264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff01d18a0 con 0x7feff0144910 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff6bb1640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feff0144910 0x7feff01dd1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fefe800e230 tx=0x7fefe8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7fefe6ffd640 1 -- 172.21.15.103:0/2355818264 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8034040 con 0x7feff0144910 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7fefe6ffd640 1 -- 172.21.15.103:0/2355818264 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe8003990 con 0x7feff0144910 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7fefe6ffd640 1 -- 172.21.15.103:0/2355818264 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8009c10 con 0x7feff0144910 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff01e0de0 con 0x7feff0144910 2024-04-25T10:33:51.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.549+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff01e13a0 con 0x7feff0144910 2024-04-25T10:33:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.550+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff01e0c10 con 0x7feff0144910 2024-04-25T10:33:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.551+0000 7fefe6ffd640 1 -- 172.21.15.103:0/2355818264 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fefe8037020 con 0x7feff0144910 2024-04-25T10:33:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.551+0000 7fefe6ffd640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fefd40744b0 0x7fefd40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.551+0000 7fefe6ffd640 1 -- 172.21.15.103:0/2355818264 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fefe80b6040 con 0x7feff0144910 2024-04-25T10:33:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.551+0000 7feff63b0640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fefd40744b0 0x7fefd40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.552+0000 7feff63b0640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fefd40744b0 0x7fefd40769c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefec009d10 tx=0x7fefec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.556+0000 7fefe6ffd640 1 -- 172.21.15.103:0/2355818264 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fefe8049060 con 0x7feff0144910 2024-04-25T10:33:51.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.730+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feff006a130 con 0x7feff0144910 2024-04-25T10:33:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.731+0000 7fefe6ffd640 1 -- 172.21.15.103:0/2355818264 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16665 (secure 0 0 0) 0x7fefe80807d0 con 0x7feff0144910 2024-04-25T10:33:51.733 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:51.733 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:44.163567+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fefd40744b0 msgr2=0x7fefd40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fefd40744b0 0x7fefd40769c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefec009d10 tx=0x7fefec008040 comp rx=0 tx=0).stop 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feff0144910 msgr2=0x7feff01dd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feff0144910 0x7feff01dd1c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fefe800e230 tx=0x7fefe8009750 comp rx=0 tx=0).stop 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 shutdown_connections 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fefd40744b0 0x7fefd40769c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feff0144910 0x7feff01dd1c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feff01d2bb0 0x7feff01443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 --2- 172.21.15.103:0/2355818264 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fefdc004d40 0x7feff01d1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 >> 172.21.15.103:0/2355818264 conn(0x7feff00b93f0 msgr2=0x7feff0075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 shutdown_connections 2024-04-25T10:33:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.733+0000 7feff8614640 1 -- 172.21.15.103:0/2355818264 wait complete. 2024-04-25T10:33:51.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:33:30.507871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:33:40.625502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:33:41.468654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:33:51.746 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:33:51.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.854+0000 7fc5a791f640 1 Processor -- start 2024-04-25T10:33:51.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.855+0000 7fc5a791f640 1 -- start start 2024-04-25T10:33:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a791f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc5a00b51d0 0x7fc5a00b6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a791f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc5a014b120 0x7fc5a0141740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a791f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a00b75e0 con 0x7fc5a0141330 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a791f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a00b7f10 con 0x7fc5a00b51d0 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a791f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a00b55e0 con 0x7fc5a014b120 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a56bb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc5a00b51d0 0x7fc5a00b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a56bb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc5a00b51d0 0x7fc5a00b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49104/0 (socket says 172.21.15.103:49104) 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a56bb640 1 -- 172.21.15.103:0/3226878166 learned_addr learned my addr 172.21.15.103:0/3226878166 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a5ebc640 1 --2- 172.21.15.103:0/3226878166 >> v2:172.21.15.132:3300/0 conn(0x7fc5a014b120 0x7fc5a0141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a56bb640 1 -- 172.21.15.103:0/3226878166 >> v2:172.21.15.132:3300/0 conn(0x7fc5a014b120 msgr2=0x7fc5a0141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a56bb640 1 --2- 172.21.15.103:0/3226878166 >> v2:172.21.15.132:3300/0 conn(0x7fc5a014b120 0x7fc5a0141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a56bb640 1 -- 172.21.15.103:0/3226878166 >> v1:172.21.15.132:6789/0 conn(0x7fc5a0141330 legacy=0x7fc5a014aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a56bb640 1 -- 172.21.15.103:0/3226878166 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a00b78c0 con 0x7fc5a00b51d0 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.856+0000 7fc5a5ebc640 1 --2- 172.21.15.103:0/3226878166 >> v2:172.21.15.132:3300/0 conn(0x7fc5a014b120 0x7fc5a0141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.857+0000 7fc5a56bb640 1 --2- 172.21.15.103:0/3226878166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a00b6220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00bc380 tx=0x7fc59802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a690c1ca3c359c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.857+0000 7fc597fff640 1 -- 172.21.15.103:0/3226878166 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598037070 con 0x7fc5a00b51d0 2024-04-25T10:33:51.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.857+0000 7fc597fff640 1 -- 172.21.15.103:0/3226878166 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc598032440 con 0x7fc5a00b51d0 2024-04-25T10:33:51.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.857+0000 7fc597fff640 1 -- 172.21.15.103:0/3226878166 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598032810 con 0x7fc5a00b51d0 2024-04-25T10:33:51.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.858+0000 7fc5a791f640 1 -- 172.21.15.103:0/3226878166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 msgr2=0x7fc5a00b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.858+0000 7fc5a791f640 1 --2- 172.21.15.103:0/3226878166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a00b6220 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00bc380 tx=0x7fc59802a1e0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.858+0000 7fc5a791f640 1 -- 172.21.15.103:0/3226878166 shutdown_connections 2024-04-25T10:33:51.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.858+0000 7fc5a791f640 1 --2- 172.21.15.103:0/3226878166 >> v2:172.21.15.132:3300/0 conn(0x7fc5a014b120 0x7fc5a0141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.858+0000 7fc5a791f640 1 --2- 172.21.15.103:0/3226878166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a00b6220 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.858+0000 7fc5a791f640 1 -- 172.21.15.103:0/3226878166 >> 172.21.15.103:0/3226878166 conn(0x7fc5a006e0c0 msgr2=0x7fc5a00bb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:51.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.858+0000 7fc5a791f640 1 -- 172.21.15.103:0/3226878166 shutdown_connections 2024-04-25T10:33:51.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.858+0000 7fc5a791f640 1 -- 172.21.15.103:0/3226878166 wait complete. 2024-04-25T10:33:51.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.859+0000 7fc5a791f640 1 Processor -- start 2024-04-25T10:33:51.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.859+0000 7fc5a791f640 1 -- start start 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a791f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a01365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a791f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5a0141330 0x7fc5a0140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a791f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5a014b120 0x7fc5a0148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a791f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a0074250 con 0x7fc5a00b51d0 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a791f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00b6a40 con 0x7fc5a0141330 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a791f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a00743d0 con 0x7fc5a014b120 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a56bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a01365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a56bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a01365f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49116/0 (socket says 172.21.15.103:49116) 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a56bb640 1 -- 172.21.15.103:0/2132213701 learned_addr learned my addr 172.21.15.103:0/2132213701 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.860+0000 7fc5a5ebc640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5a014b120 0x7fc5a0148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a4eba640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5a0141330 0x7fc5a0140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a56bb640 1 -- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5a014b120 msgr2=0x7fc5a0148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a56bb640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5a014b120 0x7fc5a0148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a56bb640 1 -- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5a0141330 msgr2=0x7fc5a0140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a56bb640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5a0141330 0x7fc5a0140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a56bb640 1 -- 172.21.15.103:0/2132213701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a013f8d0 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a5ebc640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5a014b120 0x7fc5a0148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a56bb640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a01365f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc598000c00 tx=0x7fc5980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc595ffb640 1 -- 172.21.15.103:0/2132213701 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598041020 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc595ffb640 1 -- 172.21.15.103:0/2132213701 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5980306c0 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a0135c90 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc595ffb640 1 -- 172.21.15.103:0/2132213701 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598037040 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.861+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a0134da0 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.862+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a013efa0 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.863+0000 7fc595ffb640 1 -- 172.21.15.103:0/2132213701 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc598044020 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.863+0000 7fc595ffb640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc5840744b0 0x7fc5840769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.863+0000 7fc595ffb640 1 -- 172.21.15.103:0/2132213701 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc5980b5ad0 con 0x7fc5a00b51d0 2024-04-25T10:33:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.863+0000 7fc5a4eba640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc5840744b0 0x7fc5840769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:51.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.864+0000 7fc5a4eba640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc5840744b0 0x7fc5840769c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc590007fd0 tx=0x7fc590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:51.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:51.868+0000 7fc595ffb640 1 -- 172.21.15.103:0/2132213701 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc5a013efa0 con 0x7fc5a00b51d0 2024-04-25T10:33:52.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.043+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc5a0137050 con 0x7fc5a00b51d0 2024-04-25T10:33:52.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.043+0000 7fc595ffb640 1 -- 172.21.15.103:0/2132213701 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc59804b030 con 0x7fc5a00b51d0 2024-04-25T10:33:52.045 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-04-25T10:33:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc5840744b0 msgr2=0x7fc5840769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc5840744b0 0x7fc5840769c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc590007fd0 tx=0x7fc590009040 comp rx=0 tx=0).stop 2024-04-25T10:33:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 msgr2=0x7fc5a01365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a01365f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc598000c00 tx=0x7fc5980046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 shutdown_connections 2024-04-25T10:33:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc5840744b0 0x7fc5840769c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc5a014b120 0x7fc5a0148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5a0141330 0x7fc5a0140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 --2- 172.21.15.103:0/2132213701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5a00b51d0 0x7fc5a01365f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 >> 172.21.15.103:0/2132213701 conn(0x7fc5a006e0c0 msgr2=0x7fc5a0075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:52.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 shutdown_connections 2024-04-25T10:33:52.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.045+0000 7fc5a791f640 1 -- 172.21.15.103:0/2132213701 wait complete. 2024-04-25T10:33:52.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:33:52.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.166+0000 7ffbd238f640 1 Processor -- start 2024-04-25T10:33:52.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.166+0000 7ffbd238f640 1 -- start start 2024-04-25T10:33:52.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.167+0000 7ffbd238f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffbcc06d6d0 0x7ffbcc149640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.167+0000 7ffbd238f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffbcc06dae0 0x7ffbcc153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.167+0000 7ffbd238f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbcc0b9a30 con 0x7ffbcc09d820 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.167+0000 7ffbd238f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ffbcc0b9d10 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.167+0000 7ffbd238f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ffbcc0b9ff0 con 0x7ffbcc06dae0 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.167+0000 7ffbcb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffbcc06d6d0 0x7ffbcc149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.167+0000 7ffbcb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ffbcc06d6d0 0x7ffbcc149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49118/0 (socket says 172.21.15.103:49118) 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.167+0000 7ffbcb7fe640 1 -- 172.21.15.103:0/1015815431 learned_addr learned my addr 172.21.15.103:0/1015815431 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.168+0000 7ffbd092c640 1 --2- 172.21.15.103:0/1015815431 >> v2:172.21.15.132:3300/0 conn(0x7ffbcc06dae0 0x7ffbcc153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.168+0000 7ffbcb7fe640 1 -- 172.21.15.103:0/1015815431 >> v2:172.21.15.132:3300/0 conn(0x7ffbcc06dae0 msgr2=0x7ffbcc153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.168+0000 7ffbcb7fe640 1 --2- 172.21.15.103:0/1015815431 >> v2:172.21.15.132:3300/0 conn(0x7ffbcc06dae0 0x7ffbcc153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.168+0000 7ffbcb7fe640 1 -- 172.21.15.103:0/1015815431 >> v1:172.21.15.132:6789/0 conn(0x7ffbcc09d820 legacy=0x7ffbcc0bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.168+0000 7ffbcb7fe640 1 -- 172.21.15.103:0/1015815431 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc09dc30 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.168+0000 7ffbcb7fe640 1 --2- 172.21.15.103:0/1015815431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc149640 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc06cb50 tx=0x7ffbc002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97463b8cab0e44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbcaffd640 1 -- 172.21.15.103:0/1015815431 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0037070 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbcaffd640 1 -- 172.21.15.103:0/1015815431 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc0032440 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbcaffd640 1 -- 172.21.15.103:0/1015815431 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0032810 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbd238f640 1 -- 172.21.15.103:0/1015815431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 msgr2=0x7ffbcc149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbd238f640 1 --2- 172.21.15.103:0/1015815431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc149640 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc06cb50 tx=0x7ffbc002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbd238f640 1 -- 172.21.15.103:0/1015815431 shutdown_connections 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbd238f640 1 --2- 172.21.15.103:0/1015815431 >> v2:172.21.15.132:3300/0 conn(0x7ffbcc06dae0 0x7ffbcc153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbd238f640 1 --2- 172.21.15.103:0/1015815431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc149640 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbd238f640 1 -- 172.21.15.103:0/1015815431 >> 172.21.15.103:0/1015815431 conn(0x7ffbcc0bee10 msgr2=0x7ffbcc0bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbd238f640 1 -- 172.21.15.103:0/1015815431 shutdown_connections 2024-04-25T10:33:52.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.169+0000 7ffbd238f640 1 -- 172.21.15.103:0/1015815431 wait complete. 2024-04-25T10:33:52.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.171+0000 7ffbd238f640 1 Processor -- start 2024-04-25T10:33:52.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.171+0000 7ffbd238f640 1 -- start start 2024-04-25T10:33:52.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbd238f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc0b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbd238f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffbcc06dae0 0x7ffbcc1e2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbd238f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbcc09d820 0x7ffbcc1e3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbd238f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc0b9640 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbd238f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc0b94c0 con 0x7ffbcc09d820 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbd238f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ffbcc149b80 con 0x7ffbcc06dae0 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbcbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc0b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbcbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc0b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49134/0 (socket says 172.21.15.103:49134) 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbcbfff640 1 -- 172.21.15.103:0/3592195268 learned_addr learned my addr 172.21.15.103:0/3592195268 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbcb7fe640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffbcc06dae0 0x7ffbcc1e2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.172+0000 7ffbd092c640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbcc09d820 0x7ffbcc1e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbcbfff640 1 -- 172.21.15.103:0/3592195268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffbcc06dae0 msgr2=0x7ffbcc1e2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbcbfff640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffbcc06dae0 0x7ffbcc1e2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbcbfff640 1 -- 172.21.15.103:0/3592195268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbcc09d820 msgr2=0x7ffbcc1e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbcbfff640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbcc09d820 0x7ffbcc1e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbcbfff640 1 -- 172.21.15.103:0/3592195268 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc0b2960 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbcbfff640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc0b7320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00c3c0 tx=0x7ffbbc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbc8ff9640 1 -- 172.21.15.103:0/3592195268 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0052d0 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbc8ff9640 1 -- 172.21.15.103:0/3592195268 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc005490 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc14cb30 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbc8ff9640 1 -- 172.21.15.103:0/3592195268 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc007260 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.173+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc0b2520 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.174+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbcc06a130 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.174+0000 7ffbc8ff9640 1 -- 172.21.15.103:0/3592195268 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ffbbc007400 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.175+0000 7ffbc8ff9640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ffbb80744b0 0x7ffbb80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.175+0000 7ffbcb7fe640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ffbb80744b0 0x7ffbb80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.175+0000 7ffbc8ff9640 1 -- 172.21.15.103:0/3592195268 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffbbc0945e0 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.175+0000 7ffbcb7fe640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ffbb80744b0 0x7ffbb80769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0034000 tx=0x7ffbc002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.179+0000 7ffbc8ff9640 1 -- 172.21.15.103:0/3592195268 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffbcc0b2960 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.355+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffbcc0bb250 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.355+0000 7ffbc8ff9640 1 -- 172.21.15.103:0/3592195268 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7ffbbc05e790 con 0x7ffbcc06d6d0 2024-04-25T10:33:52.357 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ffbb80744b0 msgr2=0x7ffbb80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ffbb80744b0 0x7ffbb80769c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0034000 tx=0x7ffbc002e000 comp rx=0 tx=0).stop 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 msgr2=0x7ffbcc0b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc0b7320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00c3c0 tx=0x7ffbbc00c880 comp rx=0 tx=0).stop 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 shutdown_connections 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ffbb80744b0 0x7ffbb80769c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffbcc09d820 0x7ffbcc1e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffbcc06dae0 0x7ffbcc1e2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 --2- 172.21.15.103:0/3592195268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbcc06d6d0 0x7ffbcc0b7320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 >> 172.21.15.103:0/3592195268 conn(0x7ffbcc0bee10 msgr2=0x7ffbcc09c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 shutdown_connections 2024-04-25T10:33:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.358+0000 7ffbd238f640 1 -- 172.21.15.103:0/3592195268 wait complete. 2024-04-25T10:33:52.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:33:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.478+0000 7f833aa84640 1 Processor -- start 2024-04-25T10:33:52.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.478+0000 7f833aa84640 1 -- start start 2024-04-25T10:33:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f833aa84640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8334072940 0x7f83340b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f833aa84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 0x7f83340738e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f833aa84640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83340b80b0 con 0x7f8334141070 2024-04-25T10:33:52.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f833aa84640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f83340b27a0 con 0x7f8334072940 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f833aa84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f83340b7780 con 0x7f83340b7ca0 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8338820640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8334072940 0x7f83340b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8339021640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8334141070 0x7f8334141480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33180/0 (socket says 172.21.15.103:33180) 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8338820640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8334072940 0x7f83340b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49146/0 (socket says 172.21.15.103:49146) 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8339021640 1 -- 172.21.15.103:0/2090869222 learned_addr learned my addr 172.21.15.103:0/2090869222 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8333fff640 1 --2- 172.21.15.103:0/2090869222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 0x7f83340738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8338820640 1 -- 172.21.15.103:0/2090869222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 msgr2=0x7f83340738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8338820640 1 --2- 172.21.15.103:0/2090869222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 0x7f83340738e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8338820640 1 -- 172.21.15.103:0/2090869222 >> v1:172.21.15.103:6789/0 conn(0x7f8334141070 legacy=0x7f8334141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f83337fe640 1 -- 172.21.15.103:0/2090869222 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2006400673 0 0) 0x7f83340b80b0 con 0x7f8334141070 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.479+0000 7f8338820640 1 -- 172.21.15.103:0/2090869222 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83340b2450 con 0x7f8334072940 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.480+0000 7f8338820640 1 --2- 172.21.15.103:0/2090869222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f83340b51d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83240097a0 tx=0x7f832402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea353f2af2bb05ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.480+0000 7f83337fe640 1 -- 172.21.15.103:0/2090869222 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324037070 con 0x7f8334072940 2024-04-25T10:33:52.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.480+0000 7f83337fe640 1 -- 172.21.15.103:0/2090869222 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324032440 con 0x7f8334072940 2024-04-25T10:33:52.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.480+0000 7f83337fe640 1 -- 172.21.15.103:0/2090869222 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324032810 con 0x7f8334072940 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.481+0000 7f833aa84640 1 -- 172.21.15.103:0/2090869222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 msgr2=0x7f83340b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.481+0000 7f833aa84640 1 --2- 172.21.15.103:0/2090869222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f83340b51d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83240097a0 tx=0x7f832402a180 comp rx=0 tx=0).stop 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.481+0000 7f833aa84640 1 -- 172.21.15.103:0/2090869222 shutdown_connections 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.481+0000 7f833aa84640 1 --2- 172.21.15.103:0/2090869222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 0x7f83340738e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.481+0000 7f833aa84640 1 --2- 172.21.15.103:0/2090869222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f83340b51d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.481+0000 7f833aa84640 1 -- 172.21.15.103:0/2090869222 >> 172.21.15.103:0/2090869222 conn(0x7f833406e0c0 msgr2=0x7f83340bb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.481+0000 7f833aa84640 1 -- 172.21.15.103:0/2090869222 shutdown_connections 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.481+0000 7f833aa84640 1 -- 172.21.15.103:0/2090869222 wait complete. 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.482+0000 7f833aa84640 1 Processor -- start 2024-04-25T10:33:52.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.482+0000 7f833aa84640 1 -- start start 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f833aa84640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f8334138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f833aa84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 0x7f83341396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f833aa84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8334141070 0x7f8334140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f833aa84640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8334151d50 con 0x7f8334072940 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f833aa84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8334151bd0 con 0x7f8334141070 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f833aa84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f8334151ed0 con 0x7f83340b7ca0 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f8338820640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f8334138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f8338820640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f8334138520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49156/0 (socket says 172.21.15.103:49156) 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.483+0000 7f8338820640 1 -- 172.21.15.103:0/4010965167 learned_addr learned my addr 172.21.15.103:0/4010965167 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f8333fff640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 0x7f83341396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f8338820640 1 -- 172.21.15.103:0/4010965167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 msgr2=0x7f83341396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f8338820640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 0x7f83341396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f8338820640 1 -- 172.21.15.103:0/4010965167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8334141070 msgr2=0x7f8334140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f8338820640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8334141070 0x7f8334140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f8338820640 1 -- 172.21.15.103:0/4010965167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8334138a60 con 0x7f8334072940 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f8338820640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f8334138520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8324000c00 tx=0x7f83240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f83317fa640 1 -- 172.21.15.103:0/4010965167 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324037040 con 0x7f8334072940 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f83317fa640 1 -- 172.21.15.103:0/4010965167 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8324042070 con 0x7f8334072940 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83341dd980 con 0x7f8334072940 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f83317fa640 1 -- 172.21.15.103:0/4010965167 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324030bb0 con 0x7f8334072940 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.484+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833413a3f0 con 0x7f8334072940 2024-04-25T10:33:52.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.485+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8334073f10 con 0x7f8334072940 2024-04-25T10:33:52.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.486+0000 7f83317fa640 1 -- 172.21.15.103:0/4010965167 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f8324047460 con 0x7f8334072940 2024-04-25T10:33:52.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.486+0000 7f83317fa640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f83200744e0 0x7f83200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.486+0000 7f8333fff640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f83200744e0 0x7f83200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.486+0000 7f83317fa640 1 -- 172.21.15.103:0/4010965167 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f83240b5e00 con 0x7f8334072940 2024-04-25T10:33:52.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.487+0000 7f8333fff640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f83200744e0 0x7f83200769f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8328006fd0 tx=0x7f8328008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.491+0000 7f83317fa640 1 -- 172.21.15.103:0/4010965167 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8334073f10 con 0x7f8334072940 2024-04-25T10:33:52.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.667+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f833406a130 con 0x7f8334072940 2024-04-25T10:33:52.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.667+0000 7f83317fa640 1 -- 172.21.15.103:0/4010965167 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f8324032e20 con 0x7f8334072940 2024-04-25T10:33:52.669 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-04-25T10:33:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f83200744e0 msgr2=0x7f83200769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f83200744e0 0x7f83200769f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8328006fd0 tx=0x7f8328008040 comp rx=0 tx=0).stop 2024-04-25T10:33:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 msgr2=0x7f8334138520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f8334138520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8324000c00 tx=0x7f83240046c0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 shutdown_connections 2024-04-25T10:33:52.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f83200744e0 0x7f83200769f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8334141070 0x7f8334140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83340b7ca0 0x7f83341396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 --2- 172.21.15.103:0/4010965167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8334072940 0x7f8334138520 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 >> 172.21.15.103:0/4010965167 conn(0x7f833406e0c0 msgr2=0x7f83340684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 shutdown_connections 2024-04-25T10:33:52.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.669+0000 7f833aa84640 1 -- 172.21.15.103:0/4010965167 wait complete. 2024-04-25T10:33:52.682 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:33:52.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.787+0000 7fb3109ba640 1 Processor -- start 2024-04-25T10:33:52.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.787+0000 7fb3109ba640 1 -- start start 2024-04-25T10:33:52.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb3109ba640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb30c143910 0x7fb30c0b8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb3109ba640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c153f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb3109ba640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30c143d20 con 0x7fb30c14cbb0 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb3109ba640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb30c0b3bb0 con 0x7fb30c143910 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb3109ba640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c070fd0 con 0x7fb30c14cfc0 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30a59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb30c143910 0x7fb30c0b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30a59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb30c143910 0x7fb30c0b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49164/0 (socket says 172.21.15.103:49164) 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30a59c640 1 -- 172.21.15.103:0/4239900547 learned_addr learned my addr 172.21.15.103:0/4239900547 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb309d9b640 1 --1- 172.21.15.103:0/4239900547 >> v1:172.21.15.103:6789/0 conn(0x7fb30c14cbb0 0x7fb30c071ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33192/0 (socket says 172.21.15.103:33192) 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30ad9d640 1 --2- 172.21.15.103:0/4239900547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30a59c640 1 -- 172.21.15.103:0/4239900547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 msgr2=0x7fb30c153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30a59c640 1 --2- 172.21.15.103:0/4239900547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30a59c640 1 -- 172.21.15.103:0/4239900547 >> v1:172.21.15.103:6789/0 conn(0x7fb30c14cbb0 legacy=0x7fb30c071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30a59c640 1 -- 172.21.15.103:0/4239900547 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c0706a0 con 0x7fb30c143910 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.789+0000 7fb30ad9d640 1 --2- 172.21.15.103:0/4239900547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.790+0000 7fb30a59c640 1 --2- 172.21.15.103:0/4239900547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c0b8370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009e50 tx=0x7fb2fc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5877e6a0edeb78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.790+0000 7fb30959a640 1 -- 172.21.15.103:0/4239900547 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc036070 con 0x7fb30c143910 2024-04-25T10:33:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.790+0000 7fb30959a640 1 -- 172.21.15.103:0/4239900547 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc031600 con 0x7fb30c143910 2024-04-25T10:33:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.790+0000 7fb30959a640 1 -- 172.21.15.103:0/4239900547 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0319d0 con 0x7fb30c143910 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.791+0000 7fb3109ba640 1 -- 172.21.15.103:0/4239900547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 msgr2=0x7fb30c0b8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.791+0000 7fb3109ba640 1 --2- 172.21.15.103:0/4239900547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c0b8370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009e50 tx=0x7fb2fc02a710 comp rx=0 tx=0).stop 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.791+0000 7fb3109ba640 1 -- 172.21.15.103:0/4239900547 shutdown_connections 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.791+0000 7fb3109ba640 1 --2- 172.21.15.103:0/4239900547 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.791+0000 7fb3109ba640 1 --2- 172.21.15.103:0/4239900547 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c0b8370 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.791+0000 7fb3109ba640 1 -- 172.21.15.103:0/4239900547 >> 172.21.15.103:0/4239900547 conn(0x7fb30c0b9460 msgr2=0x7fb30c0b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.791+0000 7fb3109ba640 1 -- 172.21.15.103:0/4239900547 shutdown_connections 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.791+0000 7fb3109ba640 1 -- 172.21.15.103:0/4239900547 wait complete. 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.792+0000 7fb3109ba640 1 Processor -- start 2024-04-25T10:33:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.792+0000 7fb3109ba640 1 -- start start 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.793+0000 7fb3109ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c1d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.793+0000 7fb3109ba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c14cbb0 0x7fb30c13eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.793+0000 7fb3109ba640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c13f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.793+0000 7fb3109ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c0725e0 con 0x7fb30c143910 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.793+0000 7fb3109ba640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c070c60 con 0x7fb30c14cbb0 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.793+0000 7fb3109ba640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c0b88b0 con 0x7fb30c14cfc0 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c1d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c1d38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49170/0 (socket says 172.21.15.103:49170) 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 -- 172.21.15.103:0/3916084095 learned_addr learned my addr 172.21.15.103:0/3916084095 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb309d9b640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c14cbb0 0x7fb30c13eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30ad9d640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c13f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 -- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 msgr2=0x7fb30c13f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c13f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 -- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c14cbb0 msgr2=0x7fb30c13eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c14cbb0 0x7fb30c13eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 -- 172.21.15.103:0/3916084095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c1d58c0 con 0x7fb30c143910 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30ad9d640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c13f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb30a59c640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c1d38b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc034040 tx=0x7fb2fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb2faffd640 1 -- 172.21.15.103:0/3916084095 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc03f020 con 0x7fb30c143910 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb2faffd640 1 -- 172.21.15.103:0/3916084095 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc037040 con 0x7fb30c143910 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c0bc0c0 con 0x7fb30c143910 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb2faffd640 1 -- 172.21.15.103:0/3916084095 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc036070 con 0x7fb30c143910 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.794+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c1d4060 con 0x7fb30c143910 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.795+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c06a130 con 0x7fb30c143910 2024-04-25T10:33:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.796+0000 7fb2faffd640 1 -- 172.21.15.103:0/3916084095 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb2fc042020 con 0x7fb30c143910 2024-04-25T10:33:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.796+0000 7fb2faffd640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb2ec0744b0 0x7fb2ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.796+0000 7fb309d9b640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb2ec0744b0 0x7fb2ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.796+0000 7fb2faffd640 1 -- 172.21.15.103:0/3916084095 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb2fc0b5780 con 0x7fb30c143910 2024-04-25T10:33:52.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.797+0000 7fb309d9b640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb2ec0744b0 0x7fb2ec0769c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb30c1d4f80 tx=0x7fb300007ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:52.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:52.801+0000 7fb2faffd640 1 -- 172.21.15.103:0/3916084095 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2fc049030 con 0x7fb30c143910 2024-04-25T10:33:53.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.012+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb30c0b8510 con 0x7fb30c143910 2024-04-25T10:33:53.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.012+0000 7fb2faffd640 1 -- 172.21.15.103:0/3916084095 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3530 (secure 0 0 0) 0x7fb2fc07ffa0 con 0x7fb30c143910 2024-04-25T10:33:53.014 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:53.014 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/617098639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":617098639},{"type":"v1","addr":"172.21.15.132:6833","nonce":617098639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:33:42.512740+0000","modified":"2024-04-25T10:33:44.518295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/2389441335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2389441335},{"type":"v1","addr":"172.21.15.103:6835","nonce":2389441335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-25T10:33:53.015 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-04-25T10:33:53.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.014+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb2ec0744b0 msgr2=0x7fb2ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.014+0000 7fb3109ba640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb2ec0744b0 0x7fb2ec0769c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb30c1d4f80 tx=0x7fb300007ce0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.014+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 msgr2=0x7fb30c1d38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.014+0000 7fb3109ba640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c1d38b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc034040 tx=0x7fb2fc004a40 comp rx=0 tx=0).stop 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.015+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 shutdown_connections 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.015+0000 7fb3109ba640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb2ec0744b0 0x7fb2ec0769c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.015+0000 7fb3109ba640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb30c14cfc0 0x7fb30c13f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.015+0000 7fb3109ba640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c14cbb0 0x7fb30c13eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.015+0000 7fb3109ba640 1 --2- 172.21.15.103:0/3916084095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb30c143910 0x7fb30c1d38b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.015+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 >> 172.21.15.103:0/3916084095 conn(0x7fb30c0b9460 msgr2=0x7fb30c0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.015+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 shutdown_connections 2024-04-25T10:33:53.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.015+0000 7fb3109ba640 1 -- 172.21.15.103:0/3916084095 wait complete. 2024-04-25T10:33:53.027 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:53.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.134+0000 7fab6131f640 1 Processor -- start 2024-04-25T10:33:53.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.134+0000 7fab6131f640 1 -- start start 2024-04-25T10:33:53.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab6131f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab5c143960 0x7fab5c149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab6131f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fab5c0be4c0 0x7fab5c0bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab6131f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5c0bda00 con 0x7fab5c06d2d0 2024-04-25T10:33:53.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab6131f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fab5c0be030 con 0x7fab5c0be4c0 2024-04-25T10:33:53.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab6131f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fab5c1499c0 con 0x7fab5c143960 2024-04-25T10:33:53.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab5a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fab5c0be4c0 0x7fab5c0bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab5a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fab5c0be4c0 0x7fab5c0bbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49182/0 (socket says 172.21.15.103:49182) 2024-04-25T10:33:53.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab5a7fc640 1 -- 172.21.15.103:0/1836928819 learned_addr learned my addr 172.21.15.103:0/1836928819 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:53.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.135+0000 7fab5affd640 1 --2- 172.21.15.103:0/1836928819 >> v2:172.21.15.132:3300/0 conn(0x7fab5c143960 0x7fab5c149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.136+0000 7fab5a7fc640 1 -- 172.21.15.103:0/1836928819 >> v2:172.21.15.132:3300/0 conn(0x7fab5c143960 msgr2=0x7fab5c149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:53.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.136+0000 7fab5a7fc640 1 --2- 172.21.15.103:0/1836928819 >> v2:172.21.15.132:3300/0 conn(0x7fab5c143960 0x7fab5c149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.136+0000 7fab5a7fc640 1 -- 172.21.15.103:0/1836928819 >> v1:172.21.15.132:6789/0 conn(0x7fab5c06d2d0 legacy=0x7fab5c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.136+0000 7fab5a7fc640 1 -- 172.21.15.103:0/1836928819 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c0bdcc0 con 0x7fab5c0be4c0 2024-04-25T10:33:53.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.136+0000 7fab5a7fc640 1 --2- 172.21.15.103:0/1836928819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c0be4c0 0x7fab5c0bbb00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0be1b0 tx=0x7fab5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de63eee46c257028 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.136+0000 7fab59ffb640 1 -- 172.21.15.103:0/1836928819 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50037070 con 0x7fab5c0be4c0 2024-04-25T10:33:53.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.136+0000 7fab59ffb640 1 -- 172.21.15.103:0/1836928819 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab50032440 con 0x7fab5c0be4c0 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.136+0000 7fab59ffb640 1 -- 172.21.15.103:0/1836928819 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50032810 con 0x7fab5c0be4c0 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.137+0000 7fab6131f640 1 -- 172.21.15.103:0/1836928819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c0be4c0 msgr2=0x7fab5c0bbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.137+0000 7fab6131f640 1 --2- 172.21.15.103:0/1836928819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c0be4c0 0x7fab5c0bbb00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0be1b0 tx=0x7fab5002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.137+0000 7fab6131f640 1 -- 172.21.15.103:0/1836928819 shutdown_connections 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.137+0000 7fab6131f640 1 --2- 172.21.15.103:0/1836928819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c0be4c0 0x7fab5c0bbb00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.137+0000 7fab6131f640 1 --2- 172.21.15.103:0/1836928819 >> v2:172.21.15.132:3300/0 conn(0x7fab5c143960 0x7fab5c149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.137+0000 7fab6131f640 1 -- 172.21.15.103:0/1836928819 >> 172.21.15.103:0/1836928819 conn(0x7fab5c0befa0 msgr2=0x7fab5c0bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.137+0000 7fab6131f640 1 -- 172.21.15.103:0/1836928819 shutdown_connections 2024-04-25T10:33:53.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.137+0000 7fab6131f640 1 -- 172.21.15.103:0/1836928819 wait complete. 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.139+0000 7fab6131f640 1 Processor -- start 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.139+0000 7fab6131f640 1 -- start start 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab6131f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c06d2d0 0x7fab5c14ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab6131f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fab5c0be4c0 0x7fab5c1e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab6131f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c143960 0x7fab5c142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab6131f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c153f20 con 0x7fab5c143960 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab6131f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c153da0 con 0x7fab5c06d2d0 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab6131f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fab5c1540a0 con 0x7fab5c0be4c0 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c143960 0x7fab5c142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c143960 0x7fab5c142b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49196/0 (socket says 172.21.15.103:49196) 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 -- 172.21.15.103:0/1687263892 learned_addr learned my addr 172.21.15.103:0/1687263892 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:53.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5a7fc640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fab5c0be4c0 0x7fab5c1e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5affd640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c06d2d0 0x7fab5c14ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 -- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fab5c0be4c0 msgr2=0x7fab5c1e2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fab5c0be4c0 0x7fab5c1e2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 -- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c06d2d0 msgr2=0x7fab5c14ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c06d2d0 0x7fab5c14ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 -- 172.21.15.103:0/1687263892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c0b4df0 con 0x7fab5c143960 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5affd640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c06d2d0 0x7fab5c14ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab5b7fe640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c143960 0x7fab5c142b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c760 tx=0x7fab5400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab437fe640 1 -- 172.21.15.103:0/1687263892 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54016020 con 0x7fab5c143960 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab437fe640 1 -- 172.21.15.103:0/1687263892 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab54006d50 con 0x7fab5c143960 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c146ee0 con 0x7fab5c143960 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab437fe640 1 -- 172.21.15.103:0/1687263892 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54003bb0 con 0x7fab5c143960 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.140+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab5c0b3b40 con 0x7fab5c143960 2024-04-25T10:33:53.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.141+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab5c06a130 con 0x7fab5c143960 2024-04-25T10:33:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.142+0000 7fab437fe640 1 -- 172.21.15.103:0/1687263892 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fab540050d0 con 0x7fab5c143960 2024-04-25T10:33:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.142+0000 7fab437fe640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fab480744b0 0x7fab480769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.143+0000 7fab437fe640 1 -- 172.21.15.103:0/1687263892 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fab54094cd0 con 0x7fab5c143960 2024-04-25T10:33:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.143+0000 7fab5affd640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fab480744b0 0x7fab480769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.143+0000 7fab5affd640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fab480744b0 0x7fab480769c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0b93e0 tx=0x7fab4c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.147+0000 7fab437fe640 1 -- 172.21.15.103:0/1687263892 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fab54020020 con 0x7fab5c143960 2024-04-25T10:33:53.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.325+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab5c0b8da0 con 0x7fab5c143960 2024-04-25T10:33:53.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.327+0000 7fab437fe640 1 -- 172.21.15.103:0/1687263892 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16665 (secure 0 0 0) 0x7fab5405f580 con 0x7fab5c143960 2024-04-25T10:33:53.328 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:53.329 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:44.163567+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fab480744b0 msgr2=0x7fab480769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fab480744b0 0x7fab480769c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fab5c0b93e0 tx=0x7fab4c008040 comp rx=0 tx=0).stop 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c143960 msgr2=0x7fab5c142b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c143960 0x7fab5c142b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab5400c760 tx=0x7fab5400cb60 comp rx=0 tx=0).stop 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 shutdown_connections 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fab480744b0 0x7fab480769c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab5c143960 0x7fab5c142b30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fab5c0be4c0 0x7fab5c1e2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 --2- 172.21.15.103:0/1687263892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c06d2d0 0x7fab5c14ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 >> 172.21.15.103:0/1687263892 conn(0x7fab5c0befa0 msgr2=0x7fab5c09fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 shutdown_connections 2024-04-25T10:33:53.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.329+0000 7fab6131f640 1 -- 172.21.15.103:0/1687263892 wait complete. 2024-04-25T10:33:53.342 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:33:30.507871+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:33:40.625502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:33:41.468654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:33:53.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:33:53.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.451+0000 7f9e290fa640 1 Processor -- start 2024-04-25T10:33:53.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.451+0000 7f9e290fa640 1 -- start start 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e290fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e24072370 0x7f9e240b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e290fa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24146b60 0x7f9e24150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e290fa640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e24073a90 con 0x7f9e24140390 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e290fa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9e24073d70 con 0x7f9e24072370 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e290fa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f9e24074050 con 0x7f9e24146b60 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e1bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9e24140390 0x7f9e24146450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:33204/0 (socket says 172.21.15.103:33204) 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e1bfff640 1 -- 172.21.15.103:0/709243183 learned_addr learned my addr 172.21.15.103:0/709243183 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e2359e640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24146b60 0x7f9e24150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736404196 0 0) 0x7f9e24073a90 con 0x7f9e24140390 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e10003520 con 0x7f9e24140390 2024-04-25T10:33:53.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e22d9d640 1 --2- 172.21.15.103:0/709243183 >> v2:172.21.15.132:3300/0 conn(0x7f9e24072370 0x7f9e240b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1404446750 0 0) 0x7f9e10003520 con 0x7f9e24140390 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24146b60 msgr2=0x7f9e24150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e2259c640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24146b60 0x7f9e24150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 >> v2:172.21.15.132:3300/0 conn(0x7f9e24072370 msgr2=0x7f9e240b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.452+0000 7f9e2259c640 1 --2- 172.21.15.103:0/709243183 >> v2:172.21.15.132:3300/0 conn(0x7f9e24072370 0x7f9e240b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e24073690 con 0x7f9e24140390 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f9e0c001670 con 0x7f9e24140390 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 >> v1:172.21.15.103:6789/0 conn(0x7f9e24140390 legacy=0x7f9e24146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e10003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e10004800 0x7f9e10004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24146b60 0x7f9e10005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24073d70 con 0x7f9e100039b0 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24074050 con 0x7f9e10004800 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1000ba70 con 0x7f9e24146b60 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e22d9d640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e10003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e2359e640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24146b60 0x7f9e10005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e1bfff640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e10004800 0x7f9e10004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e22d9d640 1 -- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24146b60 msgr2=0x7f9e10005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e22d9d640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24146b60 0x7f9e10005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e22d9d640 1 -- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e10004800 msgr2=0x7f9e10004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e22d9d640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e10004800 0x7f9e10004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e22d9d640 1 -- 172.21.15.103:0/709243183 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e10003520 con 0x7f9e100039b0 2024-04-25T10:33:53.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.453+0000 7f9e1bfff640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e10004800 0x7f9e10004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e22d9d640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e10003e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009ac0 tx=0x7f9e10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939728e0039ed3af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14036070 con 0x7f9e100039b0 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e14031400 con 0x7f9e100039b0 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e2259c640 1 -- 172.21.15.103:0/709243183 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14009690 con 0x7f9e100039b0 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e290fa640 1 -- 172.21.15.103:0/709243183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 msgr2=0x7f9e10003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e290fa640 1 --2- 172.21.15.103:0/709243183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e10003e20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009ac0 tx=0x7f9e10005830 comp rx=0 tx=0).stop 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e2359e640 1 -- 172.21.15.103:0/709243183 reap_dead start 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e290fa640 1 -- 172.21.15.103:0/709243183 shutdown_connections 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.454+0000 7f9e290fa640 1 -- 172.21.15.103:0/709243183 >> 172.21.15.103:0/709243183 conn(0x7f9e240b7c10 msgr2=0x7f9e240ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.455+0000 7f9e290fa640 1 -- 172.21.15.103:0/709243183 shutdown_connections 2024-04-25T10:33:53.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.455+0000 7f9e290fa640 1 -- 172.21.15.103:0/709243183 wait complete. 2024-04-25T10:33:53.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.456+0000 7f9e290fa640 1 Processor -- start 2024-04-25T10:33:53.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.456+0000 7f9e290fa640 1 -- start start 2024-04-25T10:33:53.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e290fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e241dc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e290fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2414a4e0 0x7f9e24149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e290fa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24149aa0 0x7f9e241482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e290fa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9e24140920 con 0x7f9e100039b0 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e290fa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9e241407a0 con 0x7f9e2414a4e0 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e290fa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f9e24140aa0 con 0x7f9e24149aa0 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e22d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e241dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e22d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e241dc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49204/0 (socket says 172.21.15.103:49204) 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e22d9d640 1 -- 172.21.15.103:0/2206151412 learned_addr learned my addr 172.21.15.103:0/2206151412 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e1bfff640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2414a4e0 0x7f9e24149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.457+0000 7f9e2359e640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24149aa0 0x7f9e241482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e22d9d640 1 -- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24149aa0 msgr2=0x7f9e241482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e22d9d640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24149aa0 0x7f9e241482d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e22d9d640 1 -- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2414a4e0 msgr2=0x7f9e24149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e22d9d640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2414a4e0 0x7f9e24149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e22d9d640 1 -- 172.21.15.103:0/2206151412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e241dc9a0 con 0x7f9e100039b0 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e1bfff640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2414a4e0 0x7f9e24149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e2359e640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24149aa0 0x7f9e241482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e22d9d640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e241dc460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e1402abe0 tx=0x7f9e14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e1b7fe640 1 -- 172.21.15.103:0/2206151412 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14040020 con 0x7f9e100039b0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e1b7fe640 1 -- 172.21.15.103:0/2206151412 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e140038d0 con 0x7f9e100039b0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e1b7fe640 1 -- 172.21.15.103:0/2206151412 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e14036040 con 0x7f9e100039b0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e240b49b0 con 0x7f9e100039b0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.458+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e240a0820 con 0x7f9e100039b0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.459+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e2406a130 con 0x7f9e100039b0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.459+0000 7f9e1b7fe640 1 -- 172.21.15.103:0/2206151412 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9e14043020 con 0x7f9e100039b0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.460+0000 7f9e1b7fe640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9e040744b0 0x7f9e040769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.460+0000 7f9e1b7fe640 1 -- 172.21.15.103:0/2206151412 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9e140b52f0 con 0x7f9e100039b0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.460+0000 7f9e1bfff640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9e040744b0 0x7f9e040769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.460+0000 7f9e1bfff640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9e040744b0 0x7f9e040769c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c001c50 tx=0x7f9e0c001bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.465+0000 7f9e1b7fe640 1 -- 172.21.15.103:0/2206151412 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9e1404a070 con 0x7f9e100039b0 2024-04-25T10:33:53.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.638+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9e24072f20 con 0x7f9e100039b0 2024-04-25T10:33:53.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.638+0000 7f9e1b7fe640 1 -- 172.21.15.103:0/2206151412 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f9e1407fb10 con 0x7f9e100039b0 2024-04-25T10:33:53.640 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-04-25T10:33:53.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9e040744b0 msgr2=0x7f9e040769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9e040744b0 0x7f9e040769c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c001c50 tx=0x7f9e0c001bc0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 msgr2=0x7f9e241dc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e241dc460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e1402abe0 tx=0x7f9e14004730 comp rx=0 tx=0).stop 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 shutdown_connections 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9e040744b0 0x7f9e040769c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9e24149aa0 0x7f9e241482d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2414a4e0 0x7f9e24149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 --2- 172.21.15.103:0/2206151412 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9e100039b0 0x7f9e241dc460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 >> 172.21.15.103:0/2206151412 conn(0x7f9e240b7c10 msgr2=0x7f9e2413e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 shutdown_connections 2024-04-25T10:33:53.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.640+0000 7f9e290fa640 1 -- 172.21.15.103:0/2206151412 wait complete. 2024-04-25T10:33:53.653 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:33:53.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.761+0000 7f9685be3640 1 Processor -- start 2024-04-25T10:33:53.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.761+0000 7f9685be3640 1 -- start start 2024-04-25T10:33:53.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.762+0000 7f9685be3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 0x7f96800bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.762+0000 7f9685be3640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9680149d50 con 0x7f968006dae0 2024-04-25T10:33:53.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.762+0000 7f9685be3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96800b9a30 con 0x7f968006d6d0 2024-04-25T10:33:53.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.762+0000 7f9685be3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f96800b9d10 con 0x7f968009d820 2024-04-25T10:33:53.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.762+0000 7f967ffff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f968006dae0 0x7f9680153ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60902/0 (socket says 172.21.15.103:60902) 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967ffff640 1 -- 172.21.15.103:0/3303625197 learned_addr learned my addr 172.21.15.103:0/3303625197 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967f7fe640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 0x7f96800bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980992073 0 0) 0x7f9680149d50 con 0x7f968006dae0 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9668003520 con 0x7f968006dae0 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 681585893 0 0) 0x7f9668003520 con 0x7f968006dae0 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 msgr2=0x7f96800bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 0x7f96800bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 >> v1:172.21.15.132:6789/0 conn(0x7f968006d6d0 legacy=0x7f9680149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96800b9ff0 con 0x7f968006dae0 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f96780019f0 con 0x7f968006dae0 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 >> v1:172.21.15.103:6789/0 conn(0x7f968006dae0 legacy=0x7f9680153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96680039e0 0x7f9668003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 0x7f9668004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9668004d40 0x7f9668005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f96800b9d10 con 0x7f96680039e0 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f966800bb80 con 0x7f9668004d40 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f966800bd80 con 0x7f968009d820 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967f7fe640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96680039e0 0x7f9668003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967ffff640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9668004d40 0x7f9668005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967effd640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 0x7f9668004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967f7fe640 1 -- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 msgr2=0x7f9668004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967f7fe640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 0x7f9668004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967f7fe640 1 -- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9668004d40 msgr2=0x7f9668005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967f7fe640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9668004d40 0x7f9668005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967f7fe640 1 -- 172.21.15.103:0/3303625197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9668003520 con 0x7f96680039e0 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967ffff640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9668004d40 0x7f9668005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.763+0000 7f967effd640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f968009d820 0x7f9668004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.764+0000 7f967f7fe640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96680039e0 0x7f9668003e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9670009ac0 tx=0x7f9668005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3098530202487a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.764+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670036070 con 0x7f96680039e0 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.764+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9670031400 con 0x7f96680039e0 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.764+0000 7f967e7fc640 1 -- 172.21.15.103:0/3303625197 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9670009690 con 0x7f96680039e0 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.765+0000 7f9685be3640 1 -- 172.21.15.103:0/3303625197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96680039e0 msgr2=0x7f9668003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.765+0000 7f9685be3640 1 --2- 172.21.15.103:0/3303625197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96680039e0 0x7f9668003e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9670009ac0 tx=0x7f9668005830 comp rx=0 tx=0).stop 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.765+0000 7f967ffff640 1 -- 172.21.15.103:0/3303625197 reap_dead start 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.765+0000 7f9685be3640 1 -- 172.21.15.103:0/3303625197 shutdown_connections 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.765+0000 7f9685be3640 1 -- 172.21.15.103:0/3303625197 >> 172.21.15.103:0/3303625197 conn(0x7f96800bee10 msgr2=0x7f96800bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.765+0000 7f9685be3640 1 -- 172.21.15.103:0/3303625197 shutdown_connections 2024-04-25T10:33:53.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.765+0000 7f9685be3640 1 -- 172.21.15.103:0/3303625197 wait complete. 2024-04-25T10:33:53.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.766+0000 7f9685be3640 1 Processor -- start 2024-04-25T10:33:53.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.767+0000 7f9685be3640 1 -- start start 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.767+0000 7f9685be3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96680039e0 0x7f96800b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9685be3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96801def70 0x7f96801467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9685be3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9680146d00 0x7f96800b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9685be3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f96800ba690 con 0x7f9680146d00 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9685be3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f96800ba510 con 0x7f96680039e0 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9685be3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f96800b94c0 con 0x7f96801def70 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9680146d00 0x7f96800b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9680146d00 0x7f96800b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44892/0 (socket says 172.21.15.103:44892) 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 -- 172.21.15.103:0/1116378743 learned_addr learned my addr 172.21.15.103:0/1116378743 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967effd640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96801def70 0x7f96801467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967f7fe640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96680039e0 0x7f96800b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 -- 172.21.15.103:0/1116378743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96801def70 msgr2=0x7f96801467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96801def70 0x7f96801467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 -- 172.21.15.103:0/1116378743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96680039e0 msgr2=0x7f96800b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96680039e0 0x7f96800b8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 -- 172.21.15.103:0/1116378743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96800b5140 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f967ffff640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9680146d00 0x7f96800b2520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f968008cf30 tx=0x7f967800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9667fff640 1 -- 172.21.15.103:0/1116378743 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967800eda0 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9667fff640 1 -- 172.21.15.103:0/1116378743 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9678014430 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96800b38c0 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9667fff640 1 -- 172.21.15.103:0/1116378743 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678014820 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.768+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801cfc90 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.769+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96800b4f50 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.770+0000 7f9667fff640 1 -- 172.21.15.103:0/1116378743 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f96780149c0 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.770+0000 7f9667fff640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f966c0744e0 0x7f966c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.770+0000 7f9667fff640 1 -- 172.21.15.103:0/1116378743 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f96780950f0 con 0x7f9680146d00 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.770+0000 7f967f7fe640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f966c0744e0 0x7f966c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:53.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.771+0000 7f967f7fe640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f966c0744e0 0x7f966c0769f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9670033000 tx=0x7f9670008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:53.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.775+0000 7f9667fff640 1 -- 172.21.15.103:0/1116378743 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f967805f230 con 0x7f9680146d00 2024-04-25T10:33:53.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.949+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f968006a130 con 0x7f9680146d00 2024-04-25T10:33:53.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.949+0000 7f9667fff640 1 -- 172.21.15.103:0/1116378743 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f9678063530 con 0x7f9680146d00 2024-04-25T10:33:53.951 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-04-25T10:33:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f966c0744e0 msgr2=0x7f966c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f966c0744e0 0x7f966c0769f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9670033000 tx=0x7f9670008030 comp rx=0 tx=0).stop 2024-04-25T10:33:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9680146d00 msgr2=0x7f96800b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9680146d00 0x7f96800b2520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f968008cf30 tx=0x7f967800e530 comp rx=0 tx=0).stop 2024-04-25T10:33:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 shutdown_connections 2024-04-25T10:33:53.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f966c0744e0 0x7f966c0769f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9680146d00 0x7f96800b2520 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96801def70 0x7f96801467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 --2- 172.21.15.103:0/1116378743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96680039e0 0x7f96800b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 >> 172.21.15.103:0/1116378743 conn(0x7f96800bee10 msgr2=0x7f96800bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 shutdown_connections 2024-04-25T10:33:53.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:53.951+0000 7f9685be3640 1 -- 172.21.15.103:0/1116378743 wait complete. 2024-04-25T10:33:53.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:33:54.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.073+0000 7f1ee15b2640 1 Processor -- start 2024-04-25T10:33:54.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.073+0000 7f1ee15b2640 1 -- start start 2024-04-25T10:33:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1ee15b2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc149740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1ee15b2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1edc09dd90 0x7f1edc0a0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1ee15b2640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1edc09cf80 con 0x7f1edc149c80 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1ee15b2640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1edc09d1a0 con 0x7f1edc09dd90 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1ee15b2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1edc14a2a0 con 0x7f1edc09c250 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1edb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1edc09dd90 0x7f1edc0a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1edb7fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1edc09dd90 0x7f1edc0a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44906/0 (socket says 172.21.15.103:44906) 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1eda7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1edc149c80 0x7f1edc09d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60912/0 (socket says 172.21.15.103:60912) 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.074+0000 7f1edb7fe640 1 -- 172.21.15.103:0/2848890661 learned_addr learned my addr 172.21.15.103:0/2848890661 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.075+0000 7f1edaffd640 1 --2- 172.21.15.103:0/2848890661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.075+0000 7f1edb7fe640 1 -- 172.21.15.103:0/2848890661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 msgr2=0x7f1edc149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.075+0000 7f1edb7fe640 1 --2- 172.21.15.103:0/2848890661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.075+0000 7f1edb7fe640 1 -- 172.21.15.103:0/2848890661 >> v1:172.21.15.103:6789/0 conn(0x7f1edc149c80 legacy=0x7f1edc09d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.075+0000 7f1edb7fe640 1 -- 172.21.15.103:0/2848890661 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc14a580 con 0x7f1edc09dd90 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.075+0000 7f1ed9ffb640 1 -- 172.21.15.103:0/2848890661 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948602087 0 0) 0x7f1edc09cf80 con 0x7f1edc149c80 2024-04-25T10:33:54.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.075+0000 7f1edaffd640 1 --2- 172.21.15.103:0/2848890661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.075+0000 7f1edb7fe640 1 --2- 172.21.15.103:0/2848890661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0a0400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009870 tx=0x7f1ed402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914a474681f40e74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ed9ffb640 1 -- 172.21.15.103:0/2848890661 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4037070 con 0x7f1edc09dd90 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ed9ffb640 1 -- 172.21.15.103:0/2848890661 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed4032440 con 0x7f1edc09dd90 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ed9ffb640 1 -- 172.21.15.103:0/2848890661 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4032810 con 0x7f1edc09dd90 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ee15b2640 1 -- 172.21.15.103:0/2848890661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 msgr2=0x7f1edc0a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/2848890661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0a0400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009870 tx=0x7f1ed402a1c0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ee15b2640 1 -- 172.21.15.103:0/2848890661 shutdown_connections 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/2848890661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0a0400 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/2848890661 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ee15b2640 1 -- 172.21.15.103:0/2848890661 >> 172.21.15.103:0/2848890661 conn(0x7f1edc0bb5e0 msgr2=0x7f1edc0bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ee15b2640 1 -- 172.21.15.103:0/2848890661 shutdown_connections 2024-04-25T10:33:54.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.076+0000 7f1ee15b2640 1 -- 172.21.15.103:0/2848890661 wait complete. 2024-04-25T10:33:54.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.078+0000 7f1ee15b2640 1 Processor -- start 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.078+0000 7f1ee15b2640 1 -- start start 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1ee15b2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc1df4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1ee15b2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1ee15b2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1edc149c80 0x7f1edc0a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1ee15b2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc0a0ac0 con 0x7f1edc09dd90 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1ee15b2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc0a0940 con 0x7f1edc149c80 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1ee15b2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1edc0a0c40 con 0x7f1edc09c250 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1eda7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1eda7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0b7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44912/0 (socket says 172.21.15.103:44912) 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1eda7fc640 1 -- 172.21.15.103:0/3776314798 learned_addr learned my addr 172.21.15.103:0/3776314798 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1edaffd640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc1df4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1edb7fe640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1edc149c80 0x7f1edc0a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1eda7fc640 1 -- 172.21.15.103:0/3776314798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 msgr2=0x7f1edc1df4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1eda7fc640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc1df4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1eda7fc640 1 -- 172.21.15.103:0/3776314798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1edc149c80 msgr2=0x7f1edc0a3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1eda7fc640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1edc149c80 0x7f1edc0a3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.079+0000 7f1eda7fc640 1 -- 172.21.15.103:0/3776314798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc0b30d0 con 0x7f1edc09dd90 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.080+0000 7f1eda7fc640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0b7780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000c440 tx=0x7f1ed000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.080+0000 7f1ec37fe640 1 -- 172.21.15.103:0/3776314798 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0018070 con 0x7f1edc09dd90 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.080+0000 7f1ec37fe640 1 -- 172.21.15.103:0/3776314798 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed00074a0 con 0x7f1edc09dd90 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.080+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1edc1e2e90 con 0x7f1edc09dd90 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.080+0000 7f1ec37fe640 1 -- 172.21.15.103:0/3776314798 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0004a20 con 0x7f1edc09dd90 2024-04-25T10:33:54.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.080+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1edc1e3450 con 0x7f1edc09dd90 2024-04-25T10:33:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.081+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1edc06a130 con 0x7f1edc09dd90 2024-04-25T10:33:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.081+0000 7f1ec37fe640 1 -- 172.21.15.103:0/3776314798 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1ed001b070 con 0x7f1edc09dd90 2024-04-25T10:33:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.082+0000 7f1ec37fe640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ec80744b0 0x7f1ec80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.082+0000 7f1edaffd640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ec80744b0 0x7f1ec80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.082+0000 7f1ec37fe640 1 -- 172.21.15.103:0/3776314798 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1ed00943c0 con 0x7f1edc09dd90 2024-04-25T10:33:54.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.083+0000 7f1edaffd640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ec80744b0 0x7f1ec80769c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009fd0 tx=0x7f1ecc009870 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.087+0000 7f1ec37fe640 1 -- 172.21.15.103:0/3776314798 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ed0007650 con 0x7f1edc09dd90 2024-04-25T10:33:54.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.264+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1edc0a4900 con 0x7f1edc09dd90 2024-04-25T10:33:54.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.264+0000 7f1ec37fe640 1 -- 172.21.15.103:0/3776314798 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f1ed005e500 con 0x7f1edc09dd90 2024-04-25T10:33:54.266 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-04-25T10:33:54.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ec80744b0 msgr2=0x7f1ec80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ec80744b0 0x7f1ec80769c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009fd0 tx=0x7f1ecc009870 comp rx=0 tx=0).stop 2024-04-25T10:33:54.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 msgr2=0x7f1edc0b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0b7780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000c440 tx=0x7f1ed000c900 comp rx=0 tx=0).stop 2024-04-25T10:33:54.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 shutdown_connections 2024-04-25T10:33:54.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ec80744b0 0x7f1ec80769c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1edc149c80 0x7f1edc0a3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1edc09dd90 0x7f1edc0b7780 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 --2- 172.21.15.103:0/3776314798 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1edc09c250 0x7f1edc1df4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 >> 172.21.15.103:0/3776314798 conn(0x7f1edc0bb5e0 msgr2=0x7f1edc0b9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:54.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 shutdown_connections 2024-04-25T10:33:54.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.266+0000 7f1ee15b2640 1 -- 172.21.15.103:0/3776314798 wait complete. 2024-04-25T10:33:54.279 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:33:54.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.384+0000 7ff050651640 1 Processor -- start 2024-04-25T10:33:54.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.384+0000 7ff050651640 1 -- start start 2024-04-25T10:33:54.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff050651640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0480b9190 0x7ff048071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff050651640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0480b9b40 0x7ff048142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff050651640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0480b66e0 con 0x7ff0481431f0 2024-04-25T10:33:54.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff050651640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff0480b69c0 con 0x7ff0480b9b40 2024-04-25T10:33:54.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff050651640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff048149710 con 0x7ff0480b9190 2024-04-25T10:33:54.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04ebee640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff0481431f0 0x7ff048149000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60922/0 (socket says 172.21.15.103:60922) 2024-04-25T10:33:54.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04ebee640 1 -- 172.21.15.103:0/3917119608 learned_addr learned my addr 172.21.15.103:0/3917119608 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:54.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04e3ed640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0480b9190 0x7ff048071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04dbec640 1 --2- 172.21.15.103:0/3917119608 >> v2:172.21.15.132:3300/0 conn(0x7ff0480b9b40 0x7ff048142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034938838 0 0) 0x7ff0480b66e0 con 0x7ff0481431f0 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff034003520 con 0x7ff0481431f0 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 790085654 0 0) 0x7ff034003520 con 0x7ff0481431f0 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0480b9190 msgr2=0x7ff048071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0480b9190 0x7ff048071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 >> v2:172.21.15.132:3300/0 conn(0x7ff0480b9b40 msgr2=0x7ff048142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 --2- 172.21.15.103:0/3917119608 >> v2:172.21.15.132:3300/0 conn(0x7ff0480b9b40 0x7ff048142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff048149890 con 0x7ff0481431f0 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7ff0400019f0 con 0x7ff0481431f0 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 >> v1:172.21.15.103:6789/0 conn(0x7ff0481431f0 legacy=0x7ff048149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0340039b0 0x7ff034003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff034004800 0x7ff034004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0480b9190 0x7ff034005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0480b69c0 con 0x7ff034004800 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff048149710 con 0x7ff0340039b0 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff03400baf0 con 0x7ff0480b9190 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.386+0000 7ff04dbec640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff034004800 0x7ff034004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04e3ed640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0340039b0 0x7ff034003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04ebee640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0480b9190 0x7ff034005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04dbec640 1 -- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0480b9190 msgr2=0x7ff034005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04dbec640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0480b9190 0x7ff034005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04dbec640 1 -- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0340039b0 msgr2=0x7ff034003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04dbec640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0340039b0 0x7ff034003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04dbec640 1 -- 172.21.15.103:0/3917119608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff034003520 con 0x7ff034004800 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04dbec640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff034004800 0x7ff034004c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff048070080 tx=0x7ff034005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9768674a3143cc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.387+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038036070 con 0x7ff034004800 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038031400 con 0x7ff034004800 2024-04-25T10:33:54.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff04d3eb640 1 -- 172.21.15.103:0/3917119608 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038009690 con 0x7ff034004800 2024-04-25T10:33:54.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff050651640 1 -- 172.21.15.103:0/3917119608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff034004800 msgr2=0x7ff034004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff050651640 1 --2- 172.21.15.103:0/3917119608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff034004800 0x7ff034004c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff048070080 tx=0x7ff034005830 comp rx=0 tx=0).stop 2024-04-25T10:33:54.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff04ebee640 1 -- 172.21.15.103:0/3917119608 reap_dead start 2024-04-25T10:33:54.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff050651640 1 -- 172.21.15.103:0/3917119608 shutdown_connections 2024-04-25T10:33:54.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff050651640 1 -- 172.21.15.103:0/3917119608 >> 172.21.15.103:0/3917119608 conn(0x7ff04806cfe0 msgr2=0x7ff0480b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:54.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff050651640 1 -- 172.21.15.103:0/3917119608 shutdown_connections 2024-04-25T10:33:54.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.388+0000 7ff050651640 1 -- 172.21.15.103:0/3917119608 wait complete. 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.390+0000 7ff050651640 1 Processor -- start 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.390+0000 7ff050651640 1 -- start start 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff050651640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff034004800 0x7ff048131570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff050651640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481325c0 0x7ff048132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff050651640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff048133200 0x7ff048145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff050651640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff048071960 con 0x7ff0481325c0 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff050651640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0480ba160 con 0x7ff048133200 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff050651640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff048071ae0 con 0x7ff034004800 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481325c0 0x7ff048132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481325c0 0x7ff048132cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44924/0 (socket says 172.21.15.103:44924) 2024-04-25T10:33:54.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 -- 172.21.15.103:0/2225072847 learned_addr learned my addr 172.21.15.103:0/2225072847 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04e3ed640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff034004800 0x7ff048131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04ebee640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff048133200 0x7ff048145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 -- 172.21.15.103:0/2225072847 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff034004800 msgr2=0x7ff048131570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff034004800 0x7ff048131570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 -- 172.21.15.103:0/2225072847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff048133200 msgr2=0x7ff048145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff048133200 0x7ff048145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 -- 172.21.15.103:0/2225072847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04812ff20 con 0x7ff0481325c0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff04dbec640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481325c0 0x7ff048132cc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff0480724e0 tx=0x7ff038004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.391+0000 7ff03effd640 1 -- 172.21.15.103:0/2225072847 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038040020 con 0x7ff0481325c0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.392+0000 7ff03effd640 1 -- 172.21.15.103:0/2225072847 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038003950 con 0x7ff0481325c0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.392+0000 7ff03effd640 1 -- 172.21.15.103:0/2225072847 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038036040 con 0x7ff0481325c0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.392+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff048130200 con 0x7ff0481325c0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.392+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff048132a00 con 0x7ff0481325c0 2024-04-25T10:33:54.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.392+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04806a130 con 0x7ff0481325c0 2024-04-25T10:33:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.393+0000 7ff03effd640 1 -- 172.21.15.103:0/2225072847 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff038043020 con 0x7ff0481325c0 2024-04-25T10:33:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.394+0000 7ff03effd640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff02c0744b0 0x7ff02c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.394+0000 7ff04e3ed640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff02c0744b0 0x7ff02c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.394+0000 7ff03effd640 1 -- 172.21.15.103:0/2225072847 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff0380b5520 con 0x7ff0481325c0 2024-04-25T10:33:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.394+0000 7ff04e3ed640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff02c0744b0 0x7ff02c0769c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0480742b0 tx=0x7ff044008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.398+0000 7ff03effd640 1 -- 172.21.15.103:0/2225072847 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff03804a070 con 0x7ff0481325c0 2024-04-25T10:33:54.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.610+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff048148190 con 0x7ff0481325c0 2024-04-25T10:33:54.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.610+0000 7ff03effd640 1 -- 172.21.15.103:0/2225072847 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3530 (secure 0 0 0) 0x7ff03807fcb0 con 0x7ff0481325c0 2024-04-25T10:33:54.612 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:54.612 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/617098639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":617098639},{"type":"v1","addr":"172.21.15.132:6833","nonce":617098639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:33:42.512740+0000","modified":"2024-04-25T10:33:44.518295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/2389441335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2389441335},{"type":"v1","addr":"172.21.15.103:6835","nonce":2389441335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-25T10:33:54.613 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-04-25T10:33:54.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff02c0744b0 msgr2=0x7ff02c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff02c0744b0 0x7ff02c0769c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0480742b0 tx=0x7ff044008040 comp rx=0 tx=0).stop 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481325c0 msgr2=0x7ff048132cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481325c0 0x7ff048132cc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff0480724e0 tx=0x7ff038004730 comp rx=0 tx=0).stop 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 shutdown_connections 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff02c0744b0 0x7ff02c0769c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff048133200 0x7ff048145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0481325c0 0x7ff048132cc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 --2- 172.21.15.103:0/2225072847 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff034004800 0x7ff048131570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.612+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 >> 172.21.15.103:0/2225072847 conn(0x7ff04806cfe0 msgr2=0x7ff0480ba2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.613+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 shutdown_connections 2024-04-25T10:33:54.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.613+0000 7ff050651640 1 -- 172.21.15.103:0/2225072847 wait complete. 2024-04-25T10:33:54.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:33:54.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.731+0000 7f3490e96640 1 Processor -- start 2024-04-25T10:33:54.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.731+0000 7f3490e96640 1 -- start start 2024-04-25T10:33:54.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3490e96640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f348c09c270 0x7f348c14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3490e96640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f348c09df20 0x7f348c0baa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3490e96640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f348c14d850 con 0x7f348c0ba630 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3490e96640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f348c14db30 con 0x7f348c09df20 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3490e96640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f348c09d2f0 con 0x7f348c09c270 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f348ad9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f348c09df20 0x7f348c0baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3483fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f348c0ba630 0x7f348c09d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60928/0 (socket says 172.21.15.103:60928) 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3483fff640 1 -- 172.21.15.103:0/1245436049 learned_addr learned my addr 172.21.15.103:0/1245436049 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f348a59c640 1 --2- 172.21.15.103:0/1245436049 >> v2:172.21.15.132:3300/0 conn(0x7f348c09c270 0x7f348c14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3489d9b640 1 -- 172.21.15.103:0/1245436049 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926774507 0 0) 0x7f348c14d850 con 0x7f348c0ba630 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f3489d9b640 1 -- 172.21.15.103:0/1245436049 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3478003520 con 0x7f348c0ba630 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f348ad9d640 1 -- 172.21.15.103:0/1245436049 >> v2:172.21.15.132:3300/0 conn(0x7f348c09c270 msgr2=0x7f348c14cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f348ad9d640 1 --2- 172.21.15.103:0/1245436049 >> v2:172.21.15.132:3300/0 conn(0x7f348c09c270 0x7f348c14cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f348ad9d640 1 -- 172.21.15.103:0/1245436049 >> v1:172.21.15.103:6789/0 conn(0x7f348c0ba630 legacy=0x7f348c09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.732+0000 7f348ad9d640 1 -- 172.21.15.103:0/1245436049 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c09cf70 con 0x7f348c09df20 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.733+0000 7f348ad9d640 1 --2- 172.21.15.103:0/1245436049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09df20 0x7f348c0baa40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f348c08ccf0 tx=0x7f348402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354b7d4d88f19ade server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.733+0000 7f3489d9b640 1 -- 172.21.15.103:0/1245436049 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484007740 con 0x7f348c09df20 2024-04-25T10:33:54.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.733+0000 7f3489d9b640 1 -- 172.21.15.103:0/1245436049 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34840078e0 con 0x7f348c09df20 2024-04-25T10:33:54.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.733+0000 7f3489d9b640 1 -- 172.21.15.103:0/1245436049 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484007cb0 con 0x7f348c09df20 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.734+0000 7f3490e96640 1 -- 172.21.15.103:0/1245436049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09df20 msgr2=0x7f348c0baa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.734+0000 7f3490e96640 1 --2- 172.21.15.103:0/1245436049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09df20 0x7f348c0baa40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f348c08ccf0 tx=0x7f348402a560 comp rx=0 tx=0).stop 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.734+0000 7f3490e96640 1 -- 172.21.15.103:0/1245436049 shutdown_connections 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.734+0000 7f3490e96640 1 --2- 172.21.15.103:0/1245436049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09df20 0x7f348c0baa40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.734+0000 7f3490e96640 1 --2- 172.21.15.103:0/1245436049 >> v2:172.21.15.132:3300/0 conn(0x7f348c09c270 0x7f348c14cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.734+0000 7f3490e96640 1 -- 172.21.15.103:0/1245436049 >> 172.21.15.103:0/1245436049 conn(0x7f348c0bb640 msgr2=0x7f348c0bba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.734+0000 7f3490e96640 1 -- 172.21.15.103:0/1245436049 shutdown_connections 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.734+0000 7f3490e96640 1 -- 172.21.15.103:0/1245436049 wait complete. 2024-04-25T10:33:54.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.735+0000 7f3490e96640 1 Processor -- start 2024-04-25T10:33:54.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.735+0000 7f3490e96640 1 -- start start 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f3490e96640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09c270 0x7f348c0b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f3490e96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c09df20 0x7f348c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f3490e96640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0ba630 0x7f348c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f3490e96640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f348c14d5b0 con 0x7f348c09c270 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f3490e96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f348c14d430 con 0x7f348c09df20 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f3490e96640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f348c154040 con 0x7f348c0ba630 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f348a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09c270 0x7f348c0b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f348a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09c270 0x7f348c0b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44940/0 (socket says 172.21.15.103:44940) 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f348a59c640 1 -- 172.21.15.103:0/3220108098 learned_addr learned my addr 172.21.15.103:0/3220108098 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f3483fff640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c09df20 0x7f348c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.736+0000 7f348ad9d640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0ba630 0x7f348c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f348a59c640 1 -- 172.21.15.103:0/3220108098 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0ba630 msgr2=0x7f348c0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f348a59c640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0ba630 0x7f348c0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f348a59c640 1 -- 172.21.15.103:0/3220108098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c09df20 msgr2=0x7f348c0a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f348a59c640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c09df20 0x7f348c0a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f348a59c640 1 -- 172.21.15.103:0/3220108098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c0b6500 con 0x7f348c09c270 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f348a59c640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09c270 0x7f348c0b5fc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f347c00e870 tx=0x7f347c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f3482ffd640 1 -- 172.21.15.103:0/3220108098 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c017070 con 0x7f348c09c270 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f3482ffd640 1 -- 172.21.15.103:0/3220108098 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347c00c940 con 0x7f348c09c270 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c1dfc80 con 0x7f348c09c270 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f3482ffd640 1 -- 172.21.15.103:0/3220108098 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c00cd10 con 0x7f348c09c270 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.737+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c0b54a0 con 0x7f348c09c270 2024-04-25T10:33:54.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.738+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348c06a130 con 0x7f348c09c270 2024-04-25T10:33:54.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.739+0000 7f3482ffd640 1 -- 172.21.15.103:0/3220108098 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f347c01a070 con 0x7f348c09c270 2024-04-25T10:33:54.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.739+0000 7f3482ffd640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f346c0744b0 0x7f346c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:54.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.739+0000 7f3482ffd640 1 -- 172.21.15.103:0/3220108098 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f347c095380 con 0x7f348c09c270 2024-04-25T10:33:54.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.739+0000 7f3483fff640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f346c0744b0 0x7f346c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:54.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.740+0000 7f3483fff640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f346c0744b0 0x7f346c0769c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f348c0bdb40 tx=0x7f3474009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:54.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.744+0000 7f3482ffd640 1 -- 172.21.15.103:0/3220108098 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f347c05f550 con 0x7f348c09c270 2024-04-25T10:33:54.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.918+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f348c0ba1a0 con 0x7f348c09c270 2024-04-25T10:33:54.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.919+0000 7f3482ffd640 1 -- 172.21.15.103:0/3220108098 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16665 (secure 0 0 0) 0x7f347c063850 con 0x7f348c09c270 2024-04-25T10:33:54.921 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:54.921 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":20,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:33:44.163567+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:33:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f346c0744b0 msgr2=0x7f346c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f346c0744b0 0x7f346c0769c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f348c0bdb40 tx=0x7f3474009040 comp rx=0 tx=0).stop 2024-04-25T10:33:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09c270 msgr2=0x7f348c0b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09c270 0x7f348c0b5fc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f347c00e870 tx=0x7f347c00ed30 comp rx=0 tx=0).stop 2024-04-25T10:33:54.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 shutdown_connections 2024-04-25T10:33:54.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f346c0744b0 0x7f346c0769c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f348c0ba630 0x7f348c0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f348c09df20 0x7f348c0a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 --2- 172.21.15.103:0/3220108098 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f348c09c270 0x7f348c0b5fc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:54.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.921+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 >> 172.21.15.103:0/3220108098 conn(0x7f348c0bb640 msgr2=0x7f348c0b9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:54.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.922+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 shutdown_connections 2024-04-25T10:33:54.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:54.922+0000 7f3490e96640 1 -- 172.21.15.103:0/3220108098 wait complete. 2024-04-25T10:33:54.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:33:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.039+0000 7fcf6eff8640 1 Processor -- start 2024-04-25T10:33:55.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.039+0000 7fcf6eff8640 1 -- start start 2024-04-25T10:33:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf6eff8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf680722a0 0x7fcf6814aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf6eff8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 0x7fcf681474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf6eff8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf68072070 con 0x7fcf680b8550 2024-04-25T10:33:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf6eff8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6814b080 con 0x7fcf680722a0 2024-04-25T10:33:55.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf6eff8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6814b360 con 0x7fcf68141970 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf67fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcf680b8550 0x7fcf68141260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60940/0 (socket says 172.21.15.103:60940) 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf67fff640 1 -- 172.21.15.103:0/1237787885 learned_addr learned my addr 172.21.15.103:0/1237787885 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf6cd94640 1 --2- 172.21.15.103:0/1237787885 >> v2:172.21.15.132:3300/0 conn(0x7fcf680722a0 0x7fcf6814aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614071140 0 0) 0x7fcf68072070 con 0x7fcf680b8550 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf54003520 con 0x7fcf680b8550 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf6d595640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 0x7fcf681474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2338485537 0 0) 0x7fcf54003520 con 0x7fcf680b8550 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 msgr2=0x7fcf681474f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 0x7fcf681474f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 >> v2:172.21.15.132:3300/0 conn(0x7fcf680722a0 msgr2=0x7fcf6814aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 --2- 172.21.15.103:0/1237787885 >> v2:172.21.15.132:3300/0 conn(0x7fcf680722a0 0x7fcf6814aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf680b8960 con 0x7fcf680b8550 2024-04-25T10:33:55.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fcf50001670 con 0x7fcf680b8550 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 >> v1:172.21.15.103:6789/0 conn(0x7fcf680b8550 legacy=0x7fcf68141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf54004800 0x7fcf54004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 0x7fcf54005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6814b080 con 0x7fcf540039b0 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6814b360 con 0x7fcf54004800 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.040+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5400b9c0 con 0x7fcf68141970 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6cd94640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf54003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf67fff640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf54004800 0x7fcf54004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6d595640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 0x7fcf54005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6cd94640 1 -- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 msgr2=0x7fcf54005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6cd94640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 0x7fcf54005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6cd94640 1 -- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf54004800 msgr2=0x7fcf54004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6cd94640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf54004800 0x7fcf54004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6cd94640 1 -- 172.21.15.103:0/1237787885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf54003520 con 0x7fcf540039b0 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6d595640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68141970 0x7fcf54005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf67fff640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf54004800 0x7fcf54004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.041+0000 7fcf6cd94640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf54003e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009ac0 tx=0x7fcf54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97149d923899ea5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58036070 con 0x7fcf540039b0 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58031400 con 0x7fcf540039b0 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf677fe640 1 -- 172.21.15.103:0/1237787885 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58009690 con 0x7fcf540039b0 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf6eff8640 1 -- 172.21.15.103:0/1237787885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 msgr2=0x7fcf54003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf6eff8640 1 --2- 172.21.15.103:0/1237787885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf54003e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009ac0 tx=0x7fcf54005830 comp rx=0 tx=0).stop 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf6d595640 1 -- 172.21.15.103:0/1237787885 reap_dead start 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf6eff8640 1 -- 172.21.15.103:0/1237787885 shutdown_connections 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf6eff8640 1 -- 172.21.15.103:0/1237787885 >> 172.21.15.103:0/1237787885 conn(0x7fcf680b9460 msgr2=0x7fcf680b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf6eff8640 1 -- 172.21.15.103:0/1237787885 shutdown_connections 2024-04-25T10:33:55.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.042+0000 7fcf6eff8640 1 -- 172.21.15.103:0/1237787885 wait complete. 2024-04-25T10:33:55.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.044+0000 7fcf6eff8640 1 Processor -- start 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.044+0000 7fcf6eff8640 1 -- start start 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6eff8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf681e0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6eff8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf681427a0 0x7fcf68142020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6eff8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68138a40 0x7fcf68138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6eff8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68147880 con 0x7fcf540039b0 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6eff8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68147700 con 0x7fcf681427a0 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6eff8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fcf68147a00 con 0x7fcf68138a40 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf681e0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf681e0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44952/0 (socket says 172.21.15.103:44952) 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 -- 172.21.15.103:0/2980101224 learned_addr learned my addr 172.21.15.103:0/2980101224 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf67fff640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf681427a0 0x7fcf68142020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6d595640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68138a40 0x7fcf68138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 -- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68138a40 msgr2=0x7fcf68138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68138a40 0x7fcf68138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 -- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf681427a0 msgr2=0x7fcf68142020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf681427a0 0x7fcf68142020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 -- 172.21.15.103:0/2980101224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68140d20 con 0x7fcf540039b0 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6d595640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68138a40 0x7fcf68138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.045+0000 7fcf6cd94640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf681e0820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009be0 tx=0x7fcf58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.046+0000 7fcf657fa640 1 -- 172.21.15.103:0/2980101224 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58040020 con 0x7fcf540039b0 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.046+0000 7fcf657fa640 1 -- 172.21.15.103:0/2980101224 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf580038d0 con 0x7fcf540039b0 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.046+0000 7fcf657fa640 1 -- 172.21.15.103:0/2980101224 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58036040 con 0x7fcf540039b0 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.046+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681e0d60 con 0x7fcf540039b0 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.046+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf68142560 con 0x7fcf540039b0 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.047+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf6806a130 con 0x7fcf540039b0 2024-04-25T10:33:55.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.047+0000 7fcf657fa640 1 -- 172.21.15.103:0/2980101224 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fcf58043020 con 0x7fcf540039b0 2024-04-25T10:33:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.048+0000 7fcf657fa640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fcf480744e0 0x7fcf480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.048+0000 7fcf67fff640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fcf480744e0 0x7fcf480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.048+0000 7fcf657fa640 1 -- 172.21.15.103:0/2980101224 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcf580b52d0 con 0x7fcf540039b0 2024-04-25T10:33:55.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.048+0000 7fcf67fff640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fcf480744e0 0x7fcf480769f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf6813f9e0 tx=0x7fcf50007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.052+0000 7fcf657fa640 1 -- 172.21.15.103:0/2980101224 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf5804a070 con 0x7fcf540039b0 2024-04-25T10:33:55.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.263+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf680b2d90 con 0x7fcf540039b0 2024-04-25T10:33:55.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.263+0000 7fcf657fa640 1 -- 172.21.15.103:0/2980101224 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3530 (secure 0 0 0) 0x7fcf5807f410 con 0x7fcf540039b0 2024-04-25T10:33:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:33:55.266 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/617098639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":617098639},{"type":"v1","addr":"172.21.15.132:6833","nonce":617098639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:33:42.512740+0000","modified":"2024-04-25T10:33:44.518295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/2389441335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2389441335},{"type":"v1","addr":"172.21.15.103:6835","nonce":2389441335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-25T10:33:55.267 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-04-25T10:33:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fcf480744e0 msgr2=0x7fcf480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fcf480744e0 0x7fcf480769f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf6813f9e0 tx=0x7fcf50007040 comp rx=0 tx=0).stop 2024-04-25T10:33:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 msgr2=0x7fcf681e0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf681e0820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009be0 tx=0x7fcf58004730 comp rx=0 tx=0).stop 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 shutdown_connections 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fcf480744e0 0x7fcf480769f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcf68138a40 0x7fcf68138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf681427a0 0x7fcf68142020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 --2- 172.21.15.103:0/2980101224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf540039b0 0x7fcf681e0820 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.265+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 >> 172.21.15.103:0/2980101224 conn(0x7fcf680b9460 msgr2=0x7fcf680684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.266+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 shutdown_connections 2024-04-25T10:33:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.266+0000 7fcf6eff8640 1 -- 172.21.15.103:0/2980101224 wait complete. 2024-04-25T10:33:55.480 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:33:42.512740+0000', 'modified': '2024-04-25T10:33:44.518295+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/2389441335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 2389441335}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 2389441335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-04-25T10:33:55.481 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:33:55.481 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:33:55.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.587+0000 7f1987427640 1 Processor -- start 2024-04-25T10:33:55.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.587+0000 7f1987427640 1 -- start start 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.588+0000 7f1987427640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f198006dae0 0x7f1980154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.588+0000 7f1987427640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1980149d50 con 0x7f198006d6d0 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.588+0000 7f1987427640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19800b9a30 con 0x7f198009d820 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.588+0000 7f1987427640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f19800b9d10 con 0x7f198006dae0 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f19849c2640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f198006d6d0 0x7f1980149640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60948/0 (socket says 172.21.15.103:60948) 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f19849c2640 1 -- 172.21.15.103:0/2725884040 learned_addr learned my addr 172.21.15.103:0/2725884040 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f19859c4640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f198006dae0 0x7f1980154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505333380 0 0) 0x7f1980149d50 con 0x7f198006d6d0 2024-04-25T10:33:55.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f196c003520 con 0x7f198006d6d0 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 936353692 0 0) 0x7f196c003520 con 0x7f198006d6d0 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f198006dae0 msgr2=0x7f1980154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f198006dae0 0x7f1980154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 >> v1:172.21.15.132:6789/0 conn(0x7f198009d820 legacy=0x7f19800bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19800b9ff0 con 0x7f198006d6d0 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f1970001670 con 0x7f198006d6d0 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 >> v1:172.21.15.103:6789/0 conn(0x7f198006d6d0 legacy=0x7f1980149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f196c0039e0 0x7f196c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f198006dae0 0x7f196c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f196c004d40 0x7f196c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f19800b9d10 con 0x7f196c004d40 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f196c00bb50 con 0x7f196c0039e0 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f196c00bd20 con 0x7f198006dae0 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f19859c4640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f196c004d40 0x7f196c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f19851c3640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f196c0039e0 0x7f196c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.589+0000 7f19849c2640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f198006dae0 0x7f196c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f19859c4640 1 -- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f198006dae0 msgr2=0x7f196c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f19859c4640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f198006dae0 0x7f196c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f19859c4640 1 -- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f196c0039e0 msgr2=0x7f196c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f19859c4640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f196c0039e0 0x7f196c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f19859c4640 1 -- 172.21.15.103:0/2725884040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c003520 con 0x7f196c004d40 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f19859c4640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f196c004d40 0x7f196c005150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19800be930 tx=0x7f196c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4182085079d8a0ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978009c10 con 0x7f196c004d40 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1978036070 con 0x7f196c004d40 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.590+0000 7f1977fff640 1 -- 172.21.15.103:0/2725884040 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978031830 con 0x7f196c004d40 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.591+0000 7f1987427640 1 -- 172.21.15.103:0/2725884040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f196c004d40 msgr2=0x7f196c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.591+0000 7f1987427640 1 --2- 172.21.15.103:0/2725884040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f196c004d40 0x7f196c005150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19800be930 tx=0x7f196c005830 comp rx=0 tx=0).stop 2024-04-25T10:33:55.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.591+0000 7f19859c4640 1 -- 172.21.15.103:0/2725884040 reap_dead start 2024-04-25T10:33:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.591+0000 7f1987427640 1 -- 172.21.15.103:0/2725884040 shutdown_connections 2024-04-25T10:33:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.591+0000 7f1987427640 1 -- 172.21.15.103:0/2725884040 >> 172.21.15.103:0/2725884040 conn(0x7f19800bee10 msgr2=0x7f19800bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.591+0000 7f1987427640 1 -- 172.21.15.103:0/2725884040 shutdown_connections 2024-04-25T10:33:55.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.591+0000 7f1987427640 1 -- 172.21.15.103:0/2725884040 wait complete. 2024-04-25T10:33:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.593+0000 7f1987427640 1 Processor -- start 2024-04-25T10:33:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.593+0000 7f1987427640 1 -- start start 2024-04-25T10:33:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1987427640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f196c004d40 0x7f19800b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1987427640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19801dfae0 0x7f198014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1987427640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19800b2520 0x7f198014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1987427640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f19800ba690 con 0x7f19800b2520 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1987427640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f19800ba510 con 0x7f19801dfae0 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1987427640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f19800b94c0 con 0x7f196c004d40 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19800b2520 0x7f198014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19800b2520 0x7f198014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44970/0 (socket says 172.21.15.103:44970) 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 -- 172.21.15.103:0/2193142558 learned_addr learned my addr 172.21.15.103:0/2193142558 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19851c3640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f196c004d40 0x7f19800b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19849c2640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19801dfae0 0x7f198014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 -- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f196c004d40 msgr2=0x7f19800b79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f196c004d40 0x7f19800b79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 -- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19801dfae0 msgr2=0x7f198014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19801dfae0 0x7f198014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 -- 172.21.15.103:0/2193142558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198014b380 con 0x7f19800b2520 2024-04-25T10:33:55.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19851c3640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f196c004d40 0x7f19800b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19849c2640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19801dfae0 0x7f198014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f19859c4640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19800b2520 0x7f198014d180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1978033040 tx=0x7f1978009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1975ffb640 1 -- 172.21.15.103:0/2193142558 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978009c10 con 0x7f19800b2520 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1975ffb640 1 -- 172.21.15.103:0/2193142558 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1978003990 con 0x7f19800b2520 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1975ffb640 1 -- 172.21.15.103:0/2193142558 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978003d80 con 0x7f19800b2520 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.594+0000 7f1987427640 1 -- 172.21.15.103:0/2193142558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19801e0000 con 0x7f19800b2520 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.595+0000 7f1987427640 1 -- 172.21.15.103:0/2193142558 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198014d6c0 con 0x7f19800b2520 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.597+0000 7f1975ffb640 1 -- 172.21.15.103:0/2193142558 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1978005d10 con 0x7f19800b2520 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.597+0000 7f1975ffb640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f19640744e0 0x7f19640769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.597+0000 7f19851c3640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f19640744e0 0x7f19640769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.597+0000 7f1975ffb640 1 -- 172.21.15.103:0/2193142558 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f19780b6860 con 0x7f19800b2520 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.598+0000 7f19851c3640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f19640744e0 0x7f19640769f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f197c003700 tx=0x7f197c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.598+0000 7f198e3bb740 1 Processor -- start 2024-04-25T10:33:55.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.598+0000 7f198e3bb740 1 -- start start 2024-04-25T10:33:55.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 0x562569664550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x5625696603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x56256968bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f198e3bb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5625695c9740 con 0x56256929a3b0 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f198e3bb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x5625695653a0 con 0x5625692c3270 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f198e3bb740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x5625695c5700 con 0x5625692a2590 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x5625696603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x5625696603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44972/0 (socket says 172.21.15.103:44972) 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 -- 172.21.15.103:0/403362776 learned_addr learned my addr 172.21.15.103:0/403362776 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19851c3640 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 0x562569664550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19859c4640 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x56256968bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 -- 172.21.15.103:0/403362776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 msgr2=0x56256968bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x56256968bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 -- 172.21.15.103:0/403362776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 msgr2=0x562569664550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 0x562569664550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 -- 172.21.15.103:0/403362776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562569581750 con 0x56256929a3b0 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.599+0000 7f19849c2640 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x5625696603b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1970001680 tx=0x7f1970001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2dacbeee9a5dda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f1962ffd640 1 -- 172.21.15.103:0/403362776 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197001b070 con 0x56256929a3b0 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f1962ffd640 1 -- 172.21.15.103:0/403362776 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1970007180 con 0x56256929a3b0 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f1962ffd640 1 -- 172.21.15.103:0/403362776 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970007530 con 0x56256929a3b0 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 -- 172.21.15.103:0/403362776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 msgr2=0x5625696603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x5625696603b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1970001680 tx=0x7f1970001770 comp rx=0 tx=0).stop 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 -- 172.21.15.103:0/403362776 shutdown_connections 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x56256968bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x5625696603b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 --2- 172.21.15.103:0/403362776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 0x562569664550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 -- 172.21.15.103:0/403362776 >> 172.21.15.103:0/403362776 conn(0x5625692b73c0 msgr2=0x5625696633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:55.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 -- 172.21.15.103:0/403362776 shutdown_connections 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.600+0000 7f198e3bb740 1 -- 172.21.15.103:0/403362776 wait complete. 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.601+0000 7f198e3bb740 1 -- start start 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.601+0000 7f198e3bb740 1 Processor -- start 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.602+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56256929a3b0 0x562569695cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.602+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x562569696210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.602+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x5625696a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.602+0000 7f198e3bb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562569664a90 con 0x5625692c3270 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.602+0000 7f198e3bb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562569550fe0 con 0x56256929a3b0 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.602+0000 7f198e3bb740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x562569692640 con 0x5625692a2590 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.602+0000 7f198e3bb740 10 client.0 _ll_register_callbacks cb 0x562569567150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x5625696a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x5625696a5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44988/0 (socket says 172.21.15.103:44988) 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19851c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56256929a3b0 0x562569695cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 -- 172.21.15.103:0/1524417124 learned_addr learned my addr 172.21.15.103:0/1524417124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19849c2640 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x562569696210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 -- 172.21.15.103:0/1524417124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 msgr2=0x562569696210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x562569696210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 -- 172.21.15.103:0/1524417124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56256929a3b0 msgr2=0x562569695cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56256929a3b0 0x562569695cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 -- 172.21.15.103:0/1524417124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625692db2d0 con 0x5625692c3270 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f19859c4640 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x5625696a5ac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f197807db60 tx=0x7f1978080190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd37039d98c45913 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f195bfff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f195bfff640 1 -- 172.21.15.103:0/1524417124 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19780b1030 con 0x5625692c3270 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f195bfff640 1 -- 172.21.15.103:0/1524417124 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f19780b2070 con 0x5625692c3270 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f198e3bb740 1 -- 172.21.15.103:0/1524417124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1970007180 con 0x5625692c3270 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f195bfff640 1 -- 172.21.15.103:0/1524417124 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f19780808f0 con 0x5625692c3270 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f198e3bb740 10 client.4665 fetch_fsmap learned FSMap version 6 2024-04-25T10:33:55.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f198e3bb740 1 -- 172.21.15.103:0/1524417124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5625693a56b0 con 0x5625692c3270 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.603+0000 7f195bfff640 1 -- 172.21.15.103:0/1524417124 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1970007180 con 0x5625692c3270 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f195bfff640 1 -- 172.21.15.103:0/1524417124 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7f197804d070 con 0x5625692c3270 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f198e3bb740 10 client.4665 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f198e3bb740 10 client.4665 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f198e3bb740 20 client.4665 populate_metadata read hostname 'smithi103' 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f198e3bb740 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x562569281e40 0x5625696a6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f198e3bb740 4 client.4665 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f198e3bb740 1 -- 172.21.15.103:0/1524417124 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625695d7350 con 0x562569281e40 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f19851c3640 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x562569281e40 0x5625696a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f195bfff640 10 client.4665 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.604+0000 7f19851c3640 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x562569281e40 0x5625696a6000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b85328e8d5fbd89d server_cookie=6aa1a9d40ca448e7 in_seq=0 out_seq=0 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f195bfff640 1 -- 172.21.15.103:0/1524417124 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5625695d7350 con 0x562569281e40 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f195bfff640 10 client.4665 handle_command_reply: tid=0 2024-04-25T10:33:55.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 client.4665 shutdown 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 -- 172.21.15.103:0/1524417124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 msgr2=0x5625696a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x5625696a5ac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f197807db60 tx=0x7f1978080190 comp rx=0 tx=0).stop 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 -- 172.21.15.103:0/1524417124 shutdown_connections 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x562569281e40 0x5625696a6000 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x5625696a5ac0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x562569696210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f195bfff640 0 client.4665 ms_handle_reset on v2:172.21.15.103:6834/2389441335 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 --2- 172.21.15.103:0/1524417124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56256929a3b0 0x562569695cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 -- 172.21.15.103:0/1524417124 >> 172.21.15.103:0/1524417124 conn(0x5625692b73c0 msgr2=0x56256968bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 -- 172.21.15.103:0/1524417124 shutdown_connections 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 1 -- 172.21.15.103:0/1524417124 wait complete. 2024-04-25T10:33:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.605+0000 7f198e3bb740 20 client.4665 trim_cache size 0 max 16384 2024-04-25T10:33:55.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.624+0000 7f198e3bb740 1 Processor -- start 2024-04-25T10:33:55.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.624+0000 7f198e3bb740 1 -- start start 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x56256929a3b0 0x56256965ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692a2590 0x56256968c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x56256968c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f198e3bb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f19801ec350 con 0x5625692c3270 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f198e3bb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f19801eb650 con 0x5625692a2590 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f198e3bb740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x5625696967a0 con 0x56256929a3b0 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19859c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x56256968c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19859c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x56256968c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45004/0 (socket says 172.21.15.103:45004) 2024-04-25T10:33:55.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19859c4640 1 -- 172.21.15.103:0/3448888784 learned_addr learned my addr 172.21.15.103:0/3448888784 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19859c4640 1 -- 172.21.15.103:0/3448888784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x56256929a3b0 msgr2=0x56256965ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19851c3640 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x56256929a3b0 0x56256965ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19859c4640 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x56256929a3b0 0x56256965ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19849c2640 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692a2590 0x56256968c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19859c4640 1 -- 172.21.15.103:0/3448888784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692a2590 msgr2=0x56256968c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19859c4640 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692a2590 0x56256968c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.625+0000 7f19859c4640 1 -- 172.21.15.103:0/3448888784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562569696a20 con 0x5625692c3270 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f19859c4640 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x56256968c860 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f19780095c0 tx=0x7f1978084050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865586cf18b73a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f19627fc640 1 -- 172.21.15.103:0/3448888784 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19780b1070 con 0x5625692c3270 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f19627fc640 1 -- 172.21.15.103:0/3448888784 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197809c020 con 0x5625692c3270 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f19627fc640 1 -- 172.21.15.103:0/3448888784 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978084cf0 con 0x5625692c3270 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 -- 172.21.15.103:0/3448888784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 msgr2=0x56256968c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x56256968c860 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f19780095c0 tx=0x7f1978084050 comp rx=0 tx=0).stop 2024-04-25T10:33:55.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 -- 172.21.15.103:0/3448888784 shutdown_connections 2024-04-25T10:33:55.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5625692c3270 0x56256968c860 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692a2590 0x56256968c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3448888784 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x56256929a3b0 0x56256965ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 -- 172.21.15.103:0/3448888784 >> 172.21.15.103:0/3448888784 conn(0x5625692b73c0 msgr2=0x5625696603b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:55.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 -- 172.21.15.103:0/3448888784 shutdown_connections 2024-04-25T10:33:55.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.626+0000 7f198e3bb740 1 -- 172.21.15.103:0/3448888784 wait complete. 2024-04-25T10:33:55.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.627+0000 7f198e3bb740 1 -- start start 2024-04-25T10:33:55.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.627+0000 7f198e3bb740 1 Processor -- start 2024-04-25T10:33:55.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x56256965ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x5625696945b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f198e3bb740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 0x562569694af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f198e3bb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56256968eae0 con 0x56256929a3b0 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f198e3bb740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x562569661d60 con 0x5625692c3270 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f198e3bb740 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x5625697141c0 con 0x5625692a2590 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f198e3bb740 10 client.0 _ll_register_callbacks cb 0x7f19780098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f19851c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x56256965ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f19851c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x56256965ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45016/0 (socket says 172.21.15.103:45016) 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.628+0000 7f19851c3640 1 -- 172.21.15.103:0/3826584997 learned_addr learned my addr 172.21.15.103:0/3826584997 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f19859c4640 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 0x562569694af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f19849c2640 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x5625696945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f19851c3640 1 -- 172.21.15.103:0/3826584997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 msgr2=0x5625696945b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f19851c3640 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x5625696945b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f19851c3640 1 -- 172.21.15.103:0/3826584997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 msgr2=0x562569694af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:33:55.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f19851c3640 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 0x562569694af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f19851c3640 1 -- 172.21.15.103:0/3826584997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625696a9440 con 0x56256929a3b0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f19851c3640 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x56256965ee40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x56256968fc10 tx=0x7f197c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615a2d0d49209a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f195bfff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f195bfff640 1 -- 172.21.15.103:0/3826584997 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c015af0 con 0x56256929a3b0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f195bfff640 1 -- 172.21.15.103:0/3826584997 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f197c015c90 con 0x56256929a3b0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 1 -- 172.21.15.103:0/3826584997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f197809c020 con 0x56256929a3b0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f195bfff640 1 -- 172.21.15.103:0/3826584997 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f197c038050 con 0x56256929a3b0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 10 client.4671 fetch_fsmap learned FSMap version 6 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 1 -- 172.21.15.103:0/3826584997 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5625696a5970 con 0x56256929a3b0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f195bfff640 1 -- 172.21.15.103:0/3826584997 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197809c020 con 0x56256929a3b0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f195bfff640 1 -- 172.21.15.103:0/3826584997 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7f197c03b020 con 0x56256929a3b0 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 10 client.4671 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 10 client.4671 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 20 client.4671 populate_metadata read hostname 'smithi103' 2024-04-25T10:33:55.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x56256970a010 0x56256970a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 4 client.4671 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.629+0000 7f198e3bb740 1 -- 172.21.15.103:0/3826584997 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- command(tid 0: {"prefix": "status"}) -- 0x5625695d11c0 con 0x56256970a010 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f19849c2640 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x56256970a010 0x56256970a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f195bfff640 10 client.4671 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f19849c2640 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x56256970a010 0x56256970a420 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72edf260fbd3c01 server_cookie=ea0cd74bb9e5a089 in_seq=0 out_seq=0 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f195bfff640 1 -- 172.21.15.103:0/3826584997 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5625695d11c0 con 0x56256970a010 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f195bfff640 10 client.4671 handle_command_reply: tid=0 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 client.4671 shutdown 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 -- 172.21.15.103:0/3826584997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 msgr2=0x56256965ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x56256965ee40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x56256968fc10 tx=0x7f197c001230 comp rx=0 tx=0).stop 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 -- 172.21.15.103:0/3826584997 shutdown_connections 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x56256970a010 0x56256970a420 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5625692c3270 0x562569694af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x5625692a2590 0x5625696945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f195bfff640 0 client.4671 ms_handle_reset on v2:172.21.15.103:6834/2389441335 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 --2- 172.21.15.103:0/3826584997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56256929a3b0 0x56256965ee40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.630+0000 7f198e3bb740 1 -- 172.21.15.103:0/3826584997 >> 172.21.15.103:0/3826584997 conn(0x5625692b73c0 msgr2=0x56256965ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f198e3bb740 1 -- 172.21.15.103:0/3826584997 shutdown_connections 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f198e3bb740 1 -- 172.21.15.103:0/3826584997 wait complete. 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f198e3bb740 20 client.4671 trim_cache size 0 max 16384 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "e6dc88b0-adc9-49ee-9cbd-a80811a8e643", 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-04-25T10:33:55.639 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4278, 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 12.467463271, 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 6, 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 20, 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 20, 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 19.509312653999999 2024-04-25T10:33:55.640 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 -- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f19640744e0 msgr2=0x7f19640769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f19640744e0 0x7f19640769f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f197c003700 tx=0x7f197c009040 comp rx=0 tx=0).stop 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 -- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19800b2520 msgr2=0x7f198014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19800b2520 0x7f198014d180 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1978033040 tx=0x7f1978009750 comp rx=0 tx=0).stop 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 -- 172.21.15.103:0/2193142558 shutdown_connections 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f19640744e0 0x7f19640769f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19800b2520 0x7f198014d180 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19801dfae0 0x7f198014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 --2- 172.21.15.103:0/2193142558 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f196c004d40 0x7f19800b79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:33:55.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 -- 172.21.15.103:0/2193142558 >> 172.21.15.103:0/2193142558 conn(0x7f19800bee10 msgr2=0x7f19800bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:33:55.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 -- 172.21.15.103:0/2193142558 shutdown_connections 2024-04-25T10:33:55.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:33:55.631+0000 7f1987427640 1 -- 172.21.15.103:0/2193142558 wait complete. 2024-04-25T10:33:55.645 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T10:33:55.657 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T10:33:55.657 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T10:33:55.658 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T10:33:55.658 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T10:33:55.670 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:33:55.670 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T10:33:55.670 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T10:33:55.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:33:55.686 INFO:teuthology.orchestra.run.smithi103.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T10:33:55.686 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-25T10:33:55.744 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-25T10:33:55.744 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-25T10:33:55.798 INFO:tasks.workunit:timeout=3h 2024-04-25T10:33:55.799 INFO:tasks.workunit:cleanup=True 2024-04-25T10:33:55.799 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:33:55.853 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T10:34:13.065 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:34:13.068 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:34:43.211 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:34:43.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:35:13.266 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:35:13.269 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:35:17.653 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T10:35:17.653 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-04-25T10:35:17.653 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T10:35:17.654 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-04-25T10:35:17.655 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:35:17.660 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T10:35:17.743 INFO:tasks.workunit.client.0.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T10:35:17.745 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T10:35:17.745 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T10:35:18.303 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T10:35:18.362 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T10:35:18.402 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T10:35:18.404 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T10:35:18.404 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T10:35:18.443 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T10:35:18.446 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-04-25T10:35:18.446 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T10:35:18.461 INFO:tasks.workunit:Running workunits matching client/test.sh on client.0... 2024-04-25T10:35:18.463 INFO:tasks.workunit:Running workunit client/test.sh... 2024-04-25T10:35:18.463 DEBUG:teuthology.orchestra.run.smithi103:workunit test client/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh 2024-04-25T10:35:18.519 INFO:tasks.workunit.client.0.smithi103.stderr:+ ceph_test_client 2024-04-25T10:35:18.552 INFO:tasks.workunit.client.0.smithi103.stdout:[==========] Running 25 tests from 1 test suite. 2024-04-25T10:35:18.552 INFO:tasks.workunit.client.0.smithi103.stdout:[----------] Global test environment set-up. 2024-04-25T10:35:18.552 INFO:tasks.workunit.client.0.smithi103.stdout:[----------] 25 tests from TestClient 2024-04-25T10:35:18.552 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.SingleTargetMdsCommand 2024-04-25T10:35:18.556 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.551+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.556 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.551+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.556 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3ae9d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.556 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae9f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.556 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad79fa0 con 0x55fa3ad7ce10 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3acf5e30 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad7d220 con 0x55fa3ad79b90 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39358/0 (socket says 172.21.15.103:39358) 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 -- 172.21.15.103:0/1807264527 learned_addr learned my addr 172.21.15.103:0/1807264527 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae9f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 -- 172.21.15.103:0/1807264527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 msgr2=0x55fa3ae9d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3ae9d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 -- 172.21.15.103:0/1807264527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7a9c0 msgr2=0x55fa3ae9f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae9f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aea2880 con 0x55fa3ad7ce10 2024-04-25T10:35:18.557 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea2060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f517800cd30 tx=0x7f517800a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848ab180c8ee6424 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517800add0 con 0x55fa3ad7ce10 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5178012480 con 0x55fa3ad7ce10 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f518d909480 10 client.4677 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aea7290 con 0x55fa3ad7ce10 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5175ffb640 20 client.4677 tick 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5175ffb640 20 client.4677 collect_and_send_metrics 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5175ffb640 20 client.4677 collect_and_send_global_metrics 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5175ffb640 5 client.4677 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5175ffb640 20 client.4677 trim_cache size 0 max 16384 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.552+0000 7f5175ffb640 20 client.4677 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.558 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178017070 con 0x55fa3ad7ce10 2024-04-25T10:35:18.559 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178012bc0 con 0x55fa3ad7ce10 2024-04-25T10:35:18.559 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f5185bd0640 1 client.4677 handle_mds_map epoch 6 2024-04-25T10:35:18.559 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f518d909480 20 client.4677 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.559 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f518d909480 10 client.4677 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.559 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f518d909480 20 client.4677 mds is 0 2024-04-25T10:35:18.559 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f518d909480 10 client.4677 _open_mds_session mds.0 2024-04-25T10:35:18.559 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f518d909480 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3aeaa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.560 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0a320 con 0x55fa3aea7cc0 2024-04-25T10:35:18.560 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f518d909480 10 client.4677 waiting for session to mds.0 to open 2024-04-25T10:35:18.560 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f51873d3640 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3aeaa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.560 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f5185bd0640 10 client.4677 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.560 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.553+0000 7f51873d3640 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3aeaa0e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db6d3610503f83d6 server_cookie=c14d6b8a7e6c4c4e in_seq=0 out_seq=0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0a320 con 0x55fa3aea7cc0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 renew_caps mds.0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f5170009700 con 0x55fa3aea7cc0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 connect_mds_targets for mds.0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 10 client.4677 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 20 client.4677 mds is 0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 10 client.4677 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 20 client.4677 encode_cap_releases enter (req: 0x55fa3aea7900, mds: 0) 2024-04-25T10:35:18.565 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 20 client.4677 send_request set sent_stamp to 2024-04-25T10:35:18.556783+0000 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 10 client.4677 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.553613+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.553613+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeaab60 con 0x55fa3aea7cc0 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 20 client.4677 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f5170009700 con 0x55fa3aea7cc0 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180059020 con 0x55fa3aea7cc0 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 insert_trace from 2024-04-25T10:35:18.556783+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 features 0xffffffffffffffff 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 update_snap_trace len 70 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 get_snap_realm 0x1 0x7f5170009920, nref now is 1 2024-04-25T10:35:18.566 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 15 client.4677 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 15 client.4677 snapc 1=[] 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 put_snap_realm 0x1 0x7f5170009920 2 -> 1 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f5170009a10) - ctime 2024-04-25T10:33:43.165511+0000 mtime 2024-04-25T10:33:43.165511+0000 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 dir hash is 2 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 12 client.4677 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 12 client.4677 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=- has_dir_layout 0x7f5170009a10) caps pAsLsXsFs 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 get_snap_realm 0x1 0x7f5170009920, nref was 1 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 get_snap_realm 0x1 0x7f5170009920, nref now is 2 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 15 client.4677 add_update_cap first one, opened snaprealm 0x7f5170009920 2024-04-25T10:35:18.567 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f5170009a10) 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 10 client.4677 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f5170009a10) 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 put_snap_realm 0x1 0x7f5170009920 2 -> 1 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 20 client.4677 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 20 client.4677 lat 0.000402 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 20 client.4677 _ll_get 0x7f5170009a10 0x1 -> 1 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 1 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 1 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5180050050 con 0x55fa3ad7ce10 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mon.0 v2:172.21.15.103:3300/0 5 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f517801f080 con 0x55fa3ad7ce10 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 10 client.4677 fetch_fsmap learned FSMap version 6 2024-04-25T10:35:18.568 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.556+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=6}) -- 0x55fa3aeaaec0 con 0x55fa3ad7ce10 2024-04-25T10:35:18.569 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mon.0 v2:172.21.15.103:3300/0 6 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7f5178012680 con 0x55fa3ad7ce10 2024-04-25T10:35:18.569 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T10:35:18.569 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:35:18.569 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 4 client.4677 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "session ls", "format": "json"}] 2024-04-25T10:35:18.569 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- command(tid 0: {"prefix": "session ls", "format": "json"}) -- 0x55fa3ad07a80 con 0x55fa3aea7cc0 2024-04-25T10:35:18.569 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== command_reply(tid 0: 0 ) ==== 8+0+1164 (crc 0 0 0) 0x55fa3ad07a80 con 0x55fa3aea7cc0 2024-04-25T10:35:18.569 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f5185bd0640 10 client.4677 handle_command_reply: tid=0 2024-04-25T10:35:18.570 INFO:tasks.workunit.client.0.smithi103.stdout:SingleTargetMdsCommand: [{"id":4677,"entity":{"name":{"type":"client","num":4677},"addr":{"type":"any","addr":"172.21.15.103:0","nonce":1807264527}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":0.003999926,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.99999768955596657,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.4677 172.21.15.103:0/1807264527","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"994e2f20102a20fa9a27966c14b625cc01884df8","ceph_version":"ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)","entity_id":"admin","hostname":"smithi103","pid":"43224","root":"/"}}] 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 2 client.4677 unmount 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 2 client.4677 unmounting 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 1 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 1 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 _ll_drop_pins 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 _ll_put 0x7f5170009a10 0x1 1 -> 0 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 1 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 1 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) 2024-04-25T10:35:18.572 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 nothing to flush 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 1 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 1 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 flush_caps_sync 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 trim_cache size 0 max 16384 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) n = 8 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f5170009a10) 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 15 client.4677 remove_cap last one, closing snaprealm 0x7f5170009920 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 20 client.4677 put_snap_realm 0x1 0x7f5170009920 1 -> 0 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 10 client.4677 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f5170009a10) 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 2 client.4677 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3ad7c270 con 0x55fa3aea7cc0 2024-04-25T10:35:18.573 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.557+0000 7f518d909480 2 client.4677 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ad7c270 con 0x55fa3aea7cc0 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 10 client.4677 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 5 client.4677 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 1 -- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 msgr2=0x55fa3aeaa0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3aeaa0e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 10 client.4677 remove_session_caps mds.0 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 10 client.4677 kick_requests_closed for mds.0 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 10 client.4677 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 20 client.4677 trim_cache size 0 max 16384 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f5185bd0640 10 client.4677 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f518d909480 2 client.4677 unmounted. 2024-04-25T10:35:18.574 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.558+0000 7f518d909480 1 client.4677 shutdown 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ce10 msgr2=0x55fa3aea2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea2060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f517800cd30 tx=0x7f517800a4b0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 shutdown_connections 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3aeaa0e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea2060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae9f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 --2- 172.21.15.103:0/1807264527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3ae9d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 >> 172.21.15.103:0/1807264527 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 shutdown_connections 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 -- 172.21.15.103:0/1807264527 wait complete. 2024-04-25T10:35:18.575 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 20 client.4677 trim_cache size 0 max 16384 2024-04-25T10:35:18.576 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.SingleTargetMdsCommand (8 ms) 2024-04-25T10:35:18.576 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.MultiTargetMdsCommand 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.559+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.560+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.560+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad79b90 0x55fa3ae05c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.560+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a9c0 0x55fa3aea1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.560+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3ad7e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.560+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5170007e70 con 0x55fa3ad79b90 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.560+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f517000aa20 con 0x55fa3ad7ce10 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.560+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f5170009030 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad79b90 0x55fa3ae05c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad79b90 0x55fa3ae05c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39364/0 (socket says 172.21.15.103:39364) 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 -- 172.21.15.103:0/4088445480 learned_addr learned my addr 172.21.15.103:0/4088445480 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a9c0 0x55fa3aea1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f5187bd4640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3ad7e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.581 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 -- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a9c0 msgr2=0x55fa3aea1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a9c0 0x55fa3aea1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 -- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 msgr2=0x55fa3ad7e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3ad7e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ad799c0 con 0x55fa3ad79b90 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51873d3640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad79b90 0x55fa3ae05c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5180045a00 tx=0x7f518004f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c73edaccc2402e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180062710 con 0x55fa3ad79b90 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f51800628b0 con 0x55fa3ad79b90 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f518d909480 10 client.4680 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae03170 con 0x55fa3ad79b90 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51767fc640 20 client.4680 tick 2024-04-25T10:35:18.582 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51767fc640 20 client.4680 collect_and_send_metrics 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51767fc640 20 client.4680 collect_and_send_global_metrics 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51767fc640 5 client.4680 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51767fc640 20 client.4680 trim_cache size 0 max 16384 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f51767fc640 20 client.4680 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5180062ab0 con 0x55fa3ad79b90 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066030 con 0x55fa3ad79b90 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f5184bce640 1 client.4680 handle_mds_map epoch 6 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f518d909480 20 client.4680 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f518d909480 10 client.4680 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f518d909480 20 client.4680 mds is 0 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f518d909480 10 client.4680 _open_mds_session mds.0 2024-04-25T10:35:18.583 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.561+0000 7f518d909480 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.562+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3adffbf0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.562+0000 7f518d909480 10 client.4680 waiting for session to mds.0 to open 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.562+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.562+0000 7f5184bce640 10 client.4680 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.562+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff6b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f93e991494718f39 server_cookie=4ae1dfdabad8d811 in_seq=0 out_seq=0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3adffbf0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f5184bce640 10 client.4680 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f5184bce640 10 client.4680 renew_caps mds.0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f517000b0d0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f5184bce640 10 client.4680 connect_mds_targets for mds.0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f518d909480 10 client.4680 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f518d909480 20 client.4680 mds is 0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f518d909480 10 client.4680 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.584 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f518d909480 20 client.4680 encode_cap_releases enter (req: 0x55fa3adfd2e0, mds: 0) 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f518d909480 20 client.4680 send_request set sent_stamp to 2024-04-25T10:35:18.567426+0000 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f518d909480 10 client.4680 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.562473+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.562473+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae00270 con 0x55fa3aea7cc0 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.566+0000 7f518d909480 20 client.4680 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f517000b0d0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c00b7b0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 insert_trace from 2024-04-25T10:35:18.567426+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 features 0xffffffffffffffff 2024-04-25T10:35:18.585 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 update_snap_trace len 70 2024-04-25T10:35:18.586 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.586 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 get_snap_realm 0x1 0x7f517000b2f0, nref now is 1 2024-04-25T10:35:18.586 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.586 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.586 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 15 client.4680 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.586 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 15 client.4680 snapc 1=[] 2024-04-25T10:35:18.587 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.589 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 put_snap_realm 0x1 0x7f517000b2f0 2 -> 1 2024-04-25T10:35:18.589 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.589 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f517000b3e0) - ctime 2024-04-25T10:33:43.165511+0000 mtime 2024-04-25T10:33:43.165511+0000 2024-04-25T10:35:18.589 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 dir hash is 2 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 12 client.4680 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 12 client.4680 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=- has_dir_layout 0x7f517000b3e0) caps pAsLsXsFs 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 get_snap_realm 0x1 0x7f517000b2f0, nref was 1 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 get_snap_realm 0x1 0x7f517000b2f0, nref now is 2 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 15 client.4680 add_update_cap first one, opened snaprealm 0x7f517000b2f0 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000b3e0) 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000b3e0) 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 put_snap_realm 0x1 0x7f517000b2f0 2 -> 1 2024-04-25T10:35:18.590 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.591 INFO:tasks.workunit.client.0.smithi103.stdout:MultiTargetMds: 2024-04-25T10:35:18.593 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.593 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 20 client.4680 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.593 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 20 client.4680 lat 0.000371 2024-04-25T10:35:18.593 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 20 client.4680 _ll_get 0x7f517000b3e0 0x1 -> 1 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 1 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 1 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fa3ac77d50 con 0x55fa3ad79b90 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mon.0 v2:172.21.15.103:3300/0 5 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5180072080 con 0x55fa3ad79b90 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 10 client.4680 fetch_fsmap learned FSMap version 6 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=6}) -- 0x55fa3aea59e0 con 0x55fa3ad79b90 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mon.0 v2:172.21.15.103:3300/0 6 ==== fsmap(e 6) ==== 2284+0+0 (secure 0 0 0) 0x7f5180062c60 con 0x55fa3ad79b90 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 10 client.4680 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 10 client.4680 resolve_mds: resolving `*' to all MDS daemons 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 10 client.4680 resolve_mds: appending daemon mds.b to targets 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 10 client.4680 resolve_mds: appending daemon mds.a to targets 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:6832/617098639,v1:172.21.15.132:6833/617098639] conn(0x55fa3aeae280 0x55fa3aeb06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.594 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 4 client.4680 mds_command: new command op to 4250 tid=0 multi_id=1 [{"prefix": "session ls", "format": "json"}] 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.132:6832/617098639,v1:172.21.15.132:6833/617098639] -- command(tid 0: {"prefix": "session ls", "format": "json"}) -- 0x55fa3acca1c0 con 0x55fa3aeae280 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 4 client.4680 mds_command: new command op to 4278 tid=1 multi_id=1 [{"prefix": "session ls", "format": "json"}] 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- command(tid 1: {"prefix": "session ls", "format": "json"}) -- 0x55fa3aeb0be0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== command_reply(tid 1: 0 ) ==== 8+0+1146 (crc 0 0 0) 0x55fa3aeb0be0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5184bce640 10 client.4680 handle_command_reply: tid=1 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.567+0000 7f5187bd4640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:6832/617098639,v1:172.21.15.132:6833/617098639] conn(0x55fa3aeae280 0x55fa3aeb06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f5184bce640 10 client.4680 ms_handle_connect on v2:172.21.15.132:6832/617098639 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f5187bd4640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:6832/617098639,v1:172.21.15.132:6833/617098639] conn(0x55fa3aeae280 0x55fa3aeb06a0 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=1da286ffbc10660d server_cookie=782d66a478a79c91 in_seq=0 out_seq=0 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mds.? v2:172.21.15.132:6832/617098639 1 ==== command_reply(tid 0: -38 ) ==== 8+0+0 (crc 0 0 0) 0x55fa3acca1c0 con 0x55fa3aeae280 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f5184bce640 10 client.4680 handle_command_reply: tid=0 2024-04-25T10:35:18.595 INFO:tasks.workunit.client.0.smithi103.stdout:MultiTargetMdsCommand: [{"mds.a":[{"id":4680,"entity":{"name":{"type":"client","num":4680},"addr":{"type":"any","addr":"172.21.15.103:0","nonce":4088445480}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":1,"uptime":0.004999908,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.4680 172.21.15.103:0/4088445480","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"994e2f20102a20fa9a27966c14b625cc01884df8","ceph_version":"ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)","entity_id":"admin","hostname":"smithi103","pid":"43224","root":"/"}}]}] 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 2 client.4680 unmount 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 2 client.4680 unmounting 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 1 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 1 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 _ll_drop_pins 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 _ll_put 0x7f517000b3e0 0x1 1 -> 0 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 1 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 1 2024-04-25T10:35:18.598 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 nothing to flush 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 1 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 1 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 flush_caps_sync 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 trim_cache size 0 max 16384 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) n = 8 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000b3e0) 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 15 client.4680 remove_cap last one, closing snaprealm 0x7f517000b2f0 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 20 client.4680 put_snap_realm 0x1 0x7f517000b2f0 1 -> 0 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 10 client.4680 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f517000b3e0) 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 2 client.4680 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.599 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3aeb0fe0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.568+0000 7f518d909480 2 client.4680 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aeb0fe0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 10 client.4680 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 5 client.4680 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 1 -- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 msgr2=0x55fa3adff6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff6b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 10 client.4680 remove_session_caps mds.0 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 10 client.4680 kick_requests_closed for mds.0 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 10 client.4680 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 20 client.4680 trim_cache size 0 max 16384 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 10 client.4680 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 2 client.4680 unmounted. 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 client.4680 shutdown 2024-04-25T10:35:18.600 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad79b90 msgr2=0x55fa3ae05c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad79b90 0x55fa3ae05c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5180045a00 tx=0x7f518004f000 comp rx=0 tx=0).stop 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 shutdown_connections 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:6832/617098639,v1:172.21.15.132:6833/617098639] conn(0x55fa3aeae280 0x55fa3aeb06a0 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff6b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5187bd4640 1 -- 172.21.15.103:0/4088445480 reap_dead start 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f5184bce640 0 client.4680 ms_handle_reset on v2:172.21.15.132:6832/617098639 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3ad7e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a9c0 0x55fa3aea1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 --2- 172.21.15.103:0/4088445480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad79b90 0x55fa3ae05c40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 >> 172.21.15.103:0/4088445480 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad38280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 shutdown_connections 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 1 -- 172.21.15.103:0/4088445480 wait complete. 2024-04-25T10:35:18.601 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.570+0000 7f518d909480 20 client.4680 trim_cache size 0 max 16384 2024-04-25T10:35:18.602 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.MultiTargetMdsCommand (12 ms) 2024-04-25T10:35:18.602 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.LlreadvLlwritev 2024-04-25T10:35:18.627 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.571+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.571+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3aeb06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae0d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51700076c0 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f517000c410 con 0x55fa3ad7ce10 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f5170004fb0 con 0x55fa3ad79b90 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae0d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae0d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39368/0 (socket says 172.21.15.103:39368) 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 -- 172.21.15.103:0/4086639956 learned_addr learned my addr 172.21.15.103:0/4086639956 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.628 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f51873d3640 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3aeb06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5187bd4640 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 -- 172.21.15.103:0/4086639956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 msgr2=0x55fa3aeb06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3aeb06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 -- 172.21.15.103:0/4086639956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 msgr2=0x55fa3aea1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 -- 172.21.15.103:0/4086639956 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aea55f0 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae0d0e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f517c006d80 tx=0x7f517c002f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c76cac024178c68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c018e40 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f518d909480 10 client.4683 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517c016440 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aea75e0 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5175ffb640 20 client.4683 tick 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5175ffb640 20 client.4683 collect_and_send_metrics 2024-04-25T10:35:18.629 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5175ffb640 20 client.4683 collect_and_send_global_metrics 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5175ffb640 5 client.4683 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5175ffb640 20 client.4683 trim_cache size 0 max 16384 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.572+0000 7f5175ffb640 20 client.4683 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c016640 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c016d30 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f5185bd0640 1 client.4683 handle_mds_map epoch 6 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f518d909480 20 client.4683 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f518d909480 10 client.4683 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.630 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f518d909480 20 client.4683 mds is 0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f518d909480 10 client.4683 _open_mds_session mds.0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f518d909480 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3adfccb0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f518d909480 10 client.4683 waiting for session to mds.0 to open 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f51873d3640 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f5185bd0640 10 client.4683 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.573+0000 7f51873d3640 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2562a3ae487ce4c server_cookie=ab1343d5cf4a98e2 in_seq=0 out_seq=0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3adfccb0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 renew_caps mds.0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f517000c590 con 0x55fa3aea7cc0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 connect_mds_targets for mds.0 2024-04-25T10:35:18.631 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 mds is 0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 encode_cap_releases enter (req: 0x55fa3adfc940, mds: 0) 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 send_request set sent_stamp to 2024-04-25T10:35:18.575825+0000 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.573625+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.573625+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adff840 con 0x55fa3aea7cc0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f517000c590 con 0x55fa3aea7cc0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180059050 con 0x55fa3aea7cc0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 insert_trace from 2024-04-25T10:35:18.575825+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 features 0xffffffffffffffff 2024-04-25T10:35:18.632 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 update_snap_trace len 70 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 get_snap_realm 0x1 0x7f5170001b70, nref now is 1 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 15 client.4683 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 15 client.4683 snapc 1=[] 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 put_snap_realm 0x1 0x7f5170001b70 2 -> 1 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f517000c7b0) - ctime 2024-04-25T10:33:43.165511+0000 mtime 2024-04-25T10:33:43.165511+0000 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 dir hash is 2 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 12 client.4683 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 12 client.4683 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=- has_dir_layout 0x7f517000c7b0) caps pAsLsXsFs 2024-04-25T10:35:18.633 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 get_snap_realm 0x1 0x7f5170001b70, nref was 1 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 get_snap_realm 0x1 0x7f5170001b70, nref now is 2 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 15 client.4683 add_update_cap first one, opened snaprealm 0x7f5170001b70 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c7b0) 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c7b0) 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 put_snap_realm 0x1 0x7f5170001b70 2 -> 1 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 lat 0.000323 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 _ll_get 0x7f517000c7b0 0x1 -> 1 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 2 client.4683 unmount 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 1 2024-04-25T10:35:18.634 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 1 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 unmounting: trim pass, size was 0+1 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 20 client.4683 trim_cache size 0 max 16384 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f5185bd0640 10 client.4683 unmounting: trim pass, size still 0+1 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 2 client.4683 unmounting 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 1 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 1 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 _ll_drop_pins 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 _ll_put 0x7f517000c7b0 0x1 1 -> 0 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 1 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 1 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) 2024-04-25T10:35:18.635 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 nothing to flush 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 1 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 1 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 flush_caps_sync 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 trim_cache size 0 max 16384 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) n = 8 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000c7b0) 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 15 client.4683 remove_cap last one, closing snaprealm 0x7f5170001b70 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 20 client.4683 put_snap_realm 0x1 0x7f5170001b70 1 -> 0 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 10 client.4683 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f517000c7b0) 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 2 client.4683 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3aeb0e30 con 0x55fa3aea7cc0 2024-04-25T10:35:18.636 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.575+0000 7f518d909480 2 client.4683 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aeb0e30 con 0x55fa3aea7cc0 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f5185bd0640 10 client.4683 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f5185bd0640 5 client.4683 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f5185bd0640 1 -- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 msgr2=0x55fa3adff1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f5185bd0640 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f5185bd0640 10 client.4683 remove_session_caps mds.0 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f5185bd0640 10 client.4683 kick_requests_closed for mds.0 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f518d909480 2 client.4683 unmounted. 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f518d909480 1 client.4683 shutdown 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 msgr2=0x55fa3ae0d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.577+0000 7f518d909480 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae0d0e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f517c006d80 tx=0x7f517c002f70 comp rx=0 tx=0).stop 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 shutdown_connections 2024-04-25T10:35:18.637 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3aea1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3ae0d0e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 --2- 172.21.15.103:0/4086639956 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3aeb06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 >> 172.21.15.103:0/4086639956 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 shutdown_connections 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 -- 172.21.15.103:0/4086639956 wait complete. 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 20 client.4683 trim_cache size 0 max 16384 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.578+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.579+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.579+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3aeb06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.579+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3aea4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.579+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3aeaa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.638 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.579+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51700032a0 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.579+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3aeab210 con 0x55fa3ad7ce10 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.579+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeab690 con 0x55fa3ad79b90 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.579+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3aea4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3aea4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39378/0 (socket says 172.21.15.103:39378) 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5186bd2640 1 -- 172.21.15.103:0/246626647 learned_addr learned my addr 172.21.15.103:0/246626647 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5187bd4640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3aeaa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f51873d3640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3aeb06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5186bd2640 1 -- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 msgr2=0x55fa3aeb06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5186bd2640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad79b90 0x55fa3aeb06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5186bd2640 1 -- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 msgr2=0x55fa3aeaa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5186bd2640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ce10 0x55fa3aeaa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5186bd2640 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aea4630 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.639 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5186bd2640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3aea4f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5170004d60 tx=0x7f517c00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb91ead1e38c677 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c035060 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 10 client.4686 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517c0167f0 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae06480 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f51767fc640 20 client.4686 tick 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f51767fc640 20 client.4686 collect_and_send_metrics 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f51767fc640 20 client.4686 collect_and_send_global_metrics 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f51767fc640 5 client.4686 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f51767fc640 20 client.4686 trim_cache size 0 max 16384 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f51767fc640 20 client.4686 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c016a30 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.640 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c027040 con 0x55fa3ad7a9c0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f5184bce640 1 client.4686 handle_mds_map epoch 6 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 20 client.4686 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 10 client.4686 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 20 client.4686 mds is 0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 10 client.4686 _open_mds_session mds.0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3adf79b0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.580+0000 7f518d909480 10 client.4686 waiting for session to mds.0 to open 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.581+0000 7f51873d3640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.581+0000 7f5184bce640 10 client.4686 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.581+0000 7f51873d3640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93046e7243cee6f2 server_cookie=46a914cdf286bca0 in_seq=0 out_seq=0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3adf79b0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.641 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 renew_caps mds.0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f517000c8b0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 connect_mds_targets for mds.0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 10 client.4686 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 mds is 0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 10 client.4686 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 encode_cap_releases enter (req: 0x55fa3adfeda0, mds: 0) 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 send_request set sent_stamp to 2024-04-25T10:35:18.586598+0000 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 10 client.4686 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.581378+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.581378+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb0dc0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 awaiting reply|forward|kick on 0x7ffc16ba7960 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f517000c8b0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.642 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518007c040 con 0x55fa3aea7cc0 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 insert_trace from 2024-04-25T10:35:18.586598+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 features 0xffffffffffffffff 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 update_snap_trace len 70 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref now is 1 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 15 client.4686 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 15 client.4686 snapc 1=[] 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 put_snap_realm 0x1 0x7f517000cad0 2 -> 1 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.643 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f517000cbc0) - ctime 2024-04-25T10:33:43.165511+0000 mtime 2024-04-25T10:33:43.165511+0000 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 dir hash is 2 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 12 client.4686 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 12 client.4686 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=- has_dir_layout 0x7f517000cbc0) caps pAsLsXsFs 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref was 1 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref now is 2 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 15 client.4686 add_update_cap first one, opened snaprealm 0x7f517000cad0 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 10 client.4686 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 put_snap_realm 0x1 0x7f517000cad0 2 -> 1 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 handle_client_reply signalling caller 0x7ffc16ba7960 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 lat 0.000403 2024-04-25T10:35:18.644 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 _ll_get 0x7f517000cbc0 0x1 -> 1 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f5184bce640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 8 client.4686 _ll_create 0x1.head test_llreadvllwritevfile43224 0666 578, uid 0, gid 0 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 10 client.4686 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0) dn 'test_llreadvllwritevfile43224' 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 10 client.4686 _getattr mask As issued=1 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 3 client.4686 may_create 0x7f517000cbc0 = 0 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 8 client.4686 _create(0x1 test_llreadvllwritevfile43224, 0666) 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0) name test_llreadvllwritevfile43224 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 15 open_dir 0x55fa3adf7e70 on 0x7f517000cbc0 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 15 client.4686 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0) 'test_llreadvllwritevfile43224' dn 0x1.head["test_llreadvllwritevfile43224"] (new dn) 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.645 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 choose_target_mds inode dir hash is 2 on test_llreadvllwritevfile43224 => 2156863850 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0) is_hash=1 hash=2156863850 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 10 client.4686 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 mds is 0 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 10 client.4686 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 encode_cap_releases enter (req: 0x55fa3aeb10f0, mds: 0) 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 encode_dentry_release enter(dn:0x7f5170009920) 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f517000cbc0), req:0x55fa3aeb10f0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 send_request set sent_stamp to 2024-04-25T10:35:18.587119+0000 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 10 client.4686 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevfile43224 2024-04-25T10:35:18.587084+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevfile43224 2024-04-25T10:35:18.587084+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb15a0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.586+0000 7f518d909480 20 client.4686 awaiting reply|forward|kick on 0x7ffc16ba77b0 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 850+0+0 (crc 0 0 0) 0x7f5180062c60 con 0x55fa3aea7cc0 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:18.646 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 insert_trace from 2024-04-25T10:35:18.587119+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 features 0xffffffffffffffff 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 update_snap_trace len 70 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref was 1 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref now is 2 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 hrm is_target=1 is_dentry=1 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) - ctime 2024-04-25T10:35:18.587084+0000 mtime 2024-04-25T10:35:18.587084+0000 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 12 client.4686 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 12 client.4686 add_update_inode adding 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref was 2 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref now is 3 2024-04-25T10:35:18.647 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 15 client.4686 add_update_cap first one, opened snaprealm 0x7f517000cad0 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 12 client.4686 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) caps pAsLsXs 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:33:43.165511+0000 ctime=2024-04-25T10:33:43.165511+0000 change_attr=0 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) pAsLsXs ctime 2024-04-25T10:35:18.587084+0000 mtime 2024-04-25T10:35:18.587084+0000 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 dir hash is 2 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 12 client.4686 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 1 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 12 client.4686 insert_dentry_inode 'test_llreadvllwritevfile43224' vino 0x10000000000.head in dir 0x1.head dn 0x7f5170009920 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 15 client.4686 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 'test_llreadvllwritevfile43224' to inode 0x7f517000d1a0 dn 0x1.head["test_llreadvllwritevfile43224"] (old dn) 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 link inode 0x7f517000d1a0 parents now 0x1.head["test_llreadvllwritevfile43224"] 2024-04-25T10:35:18.648 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 15 client.4686 update_dentry_lease 0x1.head["test_llreadvllwritevfile43224"] lease(mask 7 dur 30000) from 2024-04-25T10:35:18.587119+0000 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 10 client.4686 got dentry lease on test_llreadvllwritevfile43224 dur 30000ms ttl 2024-04-25T10:35:48.587119+0000 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 put_snap_realm 0x1 0x7f517000cad0 3 -> 2 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 handle_client_reply signalling caller 0x7ffc16ba77b0 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 20 client.4686 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 client.4686 delegated_inos: [] 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 client.4686 make_request created ino 0x10000000000 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 20 client.4686 make_request target is 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 20 client.4686 lat 0.002634 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.649 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 client.4686 _create_fh 0x10000000000 mode 3 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 20 client.4686 trim_cache size 1 max 16384 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 8 client.4686 create(#0x1/test_llreadvllwritevfile43224, 0100666 layout 0 0 0) = 0 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 20 client.4686 _ll_create created = 1 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 8 client.4686 _ll_create 0x1.head test_llreadvllwritevfile43224 0666 578 = 0 (0x55fa3ad7efb0 10000000000) 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 20 client.4686 _ll_get 0x7f517000d1a0 0x10000000000 -> 1 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 client.4686 fill_statx on 0x10000000000 snap/devhead mode 0100666 mtime 2024-04-25T10:35:18.587084+0000 ctime 2024-04-25T10:35:18.587084+0000 change_attr 0 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5184bce640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 client.4686 get_quota_root realm 0x1 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 10 client.4686 cur file size is 0 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3aeb34c0 0x55fa3aeb59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.650 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- osd_op(unknown.0.0:1 3.30 3:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x7f517000bb00 con 0x55fa3aeb34c0 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- osd_op(unknown.0.0:2 3.30 3:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x7f517000a110 con 0x55fa3aeb34c0 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.589+0000 7f5187bd4640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3aeb34c0 0x55fa3aeb59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.590+0000 7f5184bce640 10 client.4686 ms_handle_connect on v2:172.21.15.132:6824/2888495984 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.590+0000 7f5187bd4640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3aeb34c0 0x55fa3aeb59a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=bced6ccd9b51ac88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.590+0000 7f5187bd4640 1 -- 172.21.15.103:0/246626647 <== osd.5 v2:172.21.15.132:6824/2888495984 1 ==== osd_op_reply(1 10000000000.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3aeb34c0 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5187bd4640 1 -- 172.21.15.103:0/246626647 <== osd.5 v2:172.21.15.132:6824/2888495984 2 ==== osd_op_reply(2 10000000000.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3aeb34c0 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 wanted_max_size 0 -> 14 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 20 client.4686 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 5 client.4686 get_cap_ref got first FILE_BUFFER ref on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.651 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 5 client.4686 get_cap_ref got first FILE_CACHE ref on 0x10000000000.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={4=0,1024=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 3 client.4686 pwritev(0x55fa3ad7efb0, "...", 14, 0) = 0 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) - -> Fw 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 get_quota_root realm 0x1 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 7 client.4686 wrote to 14, extending file size 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592163+0000 ctime=2024-04-25T10:35:18.592163+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) Fw -> Fw 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592163+0000 ctime=2024-04-25T10:35:18.592163+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 19 client.4686 C_Write_Finisher::try_complete this 0x55fa3ad7bb90 onuninlinefinished 1 iofinished 1 iofinished_r 14 fsync_finished 1 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 19 client.4686 complete with iofinished_r 14 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592163+0000 ctime=2024-04-25T10:35:18.592163+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 _read_async 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592163+0000 ctime=2024-04-25T10:35:18.592163+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 0~14 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-04-25T10:35:18.652 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 3 client.4686 preadv(0x55fa3ad7efb0, 0) = 0 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_quota_root realm 0x1 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 cur file size is 14 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 wanted_max_size 14 -> 126 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592163+0000 ctime=2024-04-25T10:35:18.592163+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 20 client.4686 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592163+0000 ctime=2024-04-25T10:35:18.592163+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 3 client.4686 pwritev(0x55fa3ad7efb0, "...", 26, 100) = 0 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592163+0000 ctime=2024-04-25T10:35:18.592163+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) Fw -> Fw 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592163+0000 ctime=2024-04-25T10:35:18.592163+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.653 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 get_quota_root realm 0x1 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 7 client.4686 wrote to 126, extending file size 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592273+0000 ctime=2024-04-25T10:35:18.592273+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) Fw -> Fw 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592273+0000 ctime=2024-04-25T10:35:18.592273+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 19 client.4686 C_Write_Finisher::try_complete this 0x55fa3ad3a6c0 onuninlinefinished 1 iofinished 1 iofinished_r 26 fsync_finished 1 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 19 client.4686 complete with iofinished_r 26 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592273+0000 ctime=2024-04-25T10:35:18.592273+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 _read_async 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592273+0000 ctime=2024-04-25T10:35:18.592273+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 100~26 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 3 client.4686 preadv(0x55fa3ad7efb0, 100) = 0 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_quota_root realm 0x1 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-25T10:35:18.654 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 cur file size is 126 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 wanted_max_size 126 -> 1031 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592273+0000 ctime=2024-04-25T10:35:18.592273+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 20 client.4686 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592273+0000 ctime=2024-04-25T10:35:18.592273+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 10 client.4686 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f518d909480 3 client.4686 pwritev(0x55fa3ad7efb0, "...", 31, 1000) = 0 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592273+0000 ctime=2024-04-25T10:35:18.592273+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) Fw -> Fw 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592273+0000 ctime=2024-04-25T10:35:18.592273+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 get_quota_root realm 0x1 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 get_quota_root 0x10000000000.head -> 0x1.head 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 7 client.4686 wrote to 1031, extending file size 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) Fw -> Fw 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 19 client.4686 C_Write_Finisher::try_complete this 0x55fa3ad04f90 onuninlinefinished 1 iofinished 1 iofinished_r 31 fsync_finished 0 2024-04-25T10:35:18.655 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 19 client.4686 kickoff fsync onfinish 0x7f518000a420 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 15 client.4686 Client::C_nonblocking_fsync_state::advance progress 0 flush_wait 0 flush_completed 0 result 0 waitfor_safe 0 onfinish 0x55fa3aeb2f30 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 0 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 _flush 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- osd_op(unknown.0.0:3 3.30 3:0cf6ad0f:::10000000000.00000000:head [write 0~14 in=14b,write 100~26 in=26b,write 1000~31 in=31b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x7f515c002840 con 0x55fa3aeb34c0 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 15 client.4686 using return-valued form of _fsync 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 check_caps on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) wanted pAsxXsxFsxcrwb used Fcwb issued pAsxLsXsxFsxcrwb revoking - flags=3 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 mark_caps_flushing Fw 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 mark_caps_clean 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.656 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.591+0000 7f5189637640 10 client.4686 send_cap 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) mds.0 seq 1 used Fcwb want pAsxXsxFsxcrwb flush Fw retain pAsxLsxXsxFsxcrwbl held pAsxLsXsxFsxcrwb revoking - dropping - 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.592+0000 7f5189637640 15 client.4686 auth cap, requesting max_size 1031 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.592+0000 7f5189637640 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000000 1 seq 1 tid 2 caps=pAsxLsXsxFsxcrwb dirty=Fw wanted=pAsxXsxFsxcrwb follows 1 size 1031/1031 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.592380+0000 ctime 2024-04-25T10:35:18.592380+0000 change_attr 3) -- 0x7f515c002fd0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.592+0000 7f5189637640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 1 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.592+0000 7f5189637640 15 client.4686 waiting on data to flush 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5187bd4640 1 -- 172.21.15.103:0/246626647 <== osd.5 v2:172.21.15.132:6824/2888495984 3 ==== osd_op_reply(3 10000000000.00000000 [write 0~14,write 100~26,write 1000~31] v22'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3aeb34c0 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 10 client.4686 _flushed 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 5 client.4686 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 5 client.4686 put_cap_ref dropped last FILE_CACHE ref on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.657 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 2 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 15 client.4686 complete_flush r 0 progress 2 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 15 client.4686 Client::C_nonblocking_fsync_state::advance progress 2 flush_wait 1 flush_completed 1 result 0 waitfor_safe 0 onfinish 0x55fa3aeb2f30 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 2 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 15 client.4686 got 0 from flush writeback 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 3 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 15 client.4686 in->flushing_cap_tids.empty() 0 in->flushing_caps 4096 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 15 client.4686 Client::C_nonblocking_fsync_state::advance - flushing_caps 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 15 client.4686 Client::C_nonblocking_fsync_state::advance it->first 2 flush_tid 2 2024-04-25T10:35:18.658 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 10 client.4686 advance on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) flushing Fw flush_tid 2 last 2 2024-04-25T10:35:18.659 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f51777fe640 10 client.4686 Adding onfinish 0x55fa3aeb2f30 for C_nonblocking_fsync_state 0x7f515c001d60 2024-04-25T10:35:18.659 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_caps(flush_ack ino 0x10000000000 1 seq 1 tid 2 caps=pAsxLsXsxFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f515c002fd0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.659 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 5 client.4686 set_cap_epoch_barrier epoch = 20 2024-04-25T10:35:18.659 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 mds.0 seq now 1 2024-04-25T10:35:18.659 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 5 client.4686 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) with Fw 2024-04-25T10:35:18.659 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 5 client.4686 flushing_caps Fw -> - 2024-04-25T10:35:18.660 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) !flushing 2024-04-25T10:35:18.660 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:18.660 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 15 client.4686 C_nonblocking_fsync_state_advancer::finish r 0 2024-04-25T10:35:18.660 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 15 client.4686 Client::C_nonblocking_fsync_state::advance progress 4 flush_wait 1 flush_completed 1 result 0 waitfor_safe 0 onfinish 0x55fa3aeb2f30 2024-04-25T10:35:18.660 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 15 client.4686 Client::C_nonblocking_fsync_state::advance - case 4 2024-04-25T10:35:18.660 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 15 client.4686 in->flushing_cap_tids.empty() 1 in->flushing_caps 0 2024-04-25T10:35:18.661 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 ino 0x10000000000 has no uncommitted writes 2024-04-25T10:35:18.661 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 3 client.4686 finish_fsync r = 0 2024-04-25T10:35:18.661 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 19 client.4686 C_Write_Finisher::try_complete this 0x55fa3ad04f90 onuninlinefinished 1 iofinished 1 iofinished_r 31 fsync_finished 1 2024-04-25T10:35:18.661 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 19 client.4686 complete with iofinished_r 31 2024-04-25T10:35:18.661 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.661 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 get_caps 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 _read_async 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=1,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 1000~31 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 3 client.4686 preadv(0x55fa3ad7efb0, 1000) = 0 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 3 client.4686 ll_release (fh)0x55fa3ad7efb0 0x10000000000 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 8 client.4686 _release_fh 0x55fa3ad7efb0 mode 3 on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 _flush 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 nothing to flush 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 check_caps on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) wanted - used Fc issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:18.662 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 delaying cap release 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 _release_fh 0x55fa3ad7efb0 on inode 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) no async_err state 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 3 client.4686 ll_unlink 0x1.head test_llreadvllwritevfile43224 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0); ; name test_llreadvllwritevfile43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 _getattr mask As issued=1 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 3 client.4686 may_delete 0x7f517000cbc0 = 0 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 8 client.4686 _unlink(0x1 test_llreadvllwritevfile43224 uid 0 gid 0) 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) name test_llreadvllwritevfile43224 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 _lookup have 0x1.head["test_llreadvllwritevfile43224"] from mds.0 ttl 2024-04-25T10:35:48.587119+0000 seq 2 2024-04-25T10:35:18.663 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) test_llreadvllwritevfile43224 = 0x10000000000.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 choose_target_mds inode dir hash is 2 on test_llreadvllwritevfile43224 => 2156863850 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) is_hash=1 hash=2156863850 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 choose_target_mds from dirfragtree hash 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 mds is 0 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 encode_cap_releases enter (req: 0x55fa3aeb8720, mds: 0) 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 encode_inode_release enter(in:0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0), req:0x55fa3aeb8720 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 encode_dentry_release enter(dn:0x7f5170009920) 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0), req:0x55fa3aeb8720 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.664 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 send_request set sent_stamp to 2024-04-25T10:35:18.595076+0000 2024-04-25T10:35:18.665 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 10 client.4686 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevfile43224 2024-04-25T10:35:18.595034+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.665 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevfile43224 2024-04-25T10:35:18.595034+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb8a50 con 0x55fa3aea7cc0 2024-04-25T10:35:18.665 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f518d909480 20 client.4686 awaiting reply|forward|kick on 0x7ffc16ba7980 2024-04-25T10:35:18.665 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(revoke ino 0x10000000000 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 1031/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.592380+0000 ctime 2024-04-25T10:35:18.592380+0000 change_attr 3) ==== 260+0+0 (crc 0 0 0) 0x7f5180081040 con 0x55fa3aea7cc0 2024-04-25T10:35:18.665 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 mds.0 seq now 2 2024-04-25T10:35:18.665 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 5 client.4686 handle_cap_grant on in 0x10000000000 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:18.665 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:18.592380+0000 mtime 2024-04-25T10:35:18.592380+0000 2024-04-25T10:35:18.665 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 revocation of AxXx 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 check_caps on 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) wanted - used Fc issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 completed revocation of AxXx 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 send_cap 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile43224"] 0x7f517000d1a0) mds.0 seq 2 used Fc want - flush - retain pAsLsXsFsc held pAsxXsxFsxcrwb revoking AxXx dropping Fxrwb 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 15 client.4686 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000000 1 seq 2 caps=pAsXsFsc dirty=- wanted=- follows 0 size 1031/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.592380+0000 ctime 2024-04-25T10:35:18.592380+0000 change_attr 3) -- 0x7f515c002fd0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.594+0000 7f5184bce640 10 client.4686 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 498+0+0 (crc 0 0 0) 0x7f518005e650 con 0x55fa3aea7cc0 2024-04-25T10:35:18.666 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 handle_client_reply got a reply. Safe:0 tid 3 2024-04-25T10:35:18.667 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 10 client.4686 insert_trace from 2024-04-25T10:35:18.595076+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:18.667 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 10 client.4686 features 0xffffffffffffffff 2024-04-25T10:35:18.667 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 10 client.4686 update_snap_trace len 70 2024-04-25T10:35:18.667 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref was 2 2024-04-25T10:35:18.667 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 get_snap_realm 0x1 0x7f517000cad0, nref now is 3 2024-04-25T10:35:18.667 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 10 client.4686 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.668 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 10 client.4686 hrm is_target=0 is_dentry=1 2024-04-25T10:35:18.668 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 12 client.4686 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) caps pAsLsXs 2024-04-25T10:35:18.668 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.587084+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) pAsLsXs ctime 2024-04-25T10:35:18.595034+0000 mtime 2024-04-25T10:35:18.587084+0000 2024-04-25T10:35:18.668 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 dir hash is 2 2024-04-25T10:35:18.668 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 12 client.4686 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 2 2024-04-25T10:35:18.668 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 10 client.4686 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.668 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 15 client.4686 unlink dir 0x7f517000cbc0 'test_llreadvllwritevfile43224' dn 0x7f5170009920 inode 0x7f517000d1a0 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 unlink inode 0x7f517000d1a0 parents now 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 15 client.4686 update_dentry_lease 0x1.head["test_llreadvllwritevfile43224"] lease(mask 3 dur 30000) from 2024-04-25T10:35:18.595076+0000 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 10 client.4686 got dentry lease on test_llreadvllwritevfile43224 dur 30000ms ttl 2024-04-25T10:35:48.595076+0000 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 put_snap_realm 0x1 0x7f517000cad0 3 -> 2 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 handle_client_reply signalling caller 0x7ffc16ba7980 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f5184bce640 20 client.4686 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 20 client.4686 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 20 client.4686 lat 0.001121 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 20 client.4686 trim_cache size 1 max 16384 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 8 client.4686 unlink(#0x1/test_llreadvllwritevfile43224) = 0 2024-04-25T10:35:18.669 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 2 client.4686 unmount 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 2 client.4686 unmounting 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3aeb8d80 con 0x55fa3aea7cc0 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.595+0000 7f518d909480 10 client.4686 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(grant ino 0x10000000000 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 1031/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.592380+0000 ctime 2024-04-25T10:35:18.595034+0000 change_attr 4) ==== 260+0+0 (crc 0 0 0) 0x7f515c002fd0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 mds.0 seq now 3 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 5 client.4686 handle_cap_grant on in 0x10000000000 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFsc 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.592380+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) pAsXsFsc ctime 2024-04-25T10:35:18.595034+0000 mtime 2024-04-25T10:35:18.592380+0000 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 max_size 4194304 -> 0 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 grant, new caps are LsFxrwb 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.670 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 5 client.4686 _try_to_trim_inode in 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 20 client.4686 trim_cache size 1 max 16384 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 unmounting: trim pass, size still 1+2 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f518005e840 con 0x55fa3aea7cc0 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 insert_trace from 2024-04-25T10:35:18.595076+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 20 client.4686 trim_cache size 1 max 16384 2024-04-25T10:35:18.671 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 15 client.4686 trim_dentry unlinking dn test_llreadvllwritevfile43224 in dir 0x1 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 15 client.4686 unlink dir 0x7f517000cbc0 'test_llreadvllwritevfile43224' dn 0x7f5170009920 inode 0 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 15 client.4686 unlink removing 'test_llreadvllwritevfile43224' dn 0x7f5170009920 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 15 client.4686 close_dir dir 0x55fa3adf7e70 on 0x7f517000cbc0 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 10 client.4686 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _ll_drop_pins 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 _ll_put 0x7f517000d1a0 0x10000000000 1 -> 0 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 _ll_put 0x7f517000cbc0 0x1 2 -> 0 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.672 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 _release 0x10000000000.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _invalidate_inode_cache 0x10000000000.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d1a0) 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _flush 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 nothing to flush 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 nothing to flush 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) n = 1 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 1 2024-04-25T10:35:18.673 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 flush_caps_sync 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 trim_cache size 0 max 16384 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) n = 11 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 15 client.4686 remove_cap last one, closing snaprealm 0x7f517000cad0 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_snap_realm 0x1 0x7f517000cad0 2 -> 1 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.587084+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=- COMPLETE has_dir_layout 0x7f517000cbc0) 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _put_inode on 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) n = 19 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 remove_cap mds.0 on 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) 2024-04-25T10:35:18.674 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 15 client.4686 remove_cap last one, closing snaprealm 0x7f517000cad0 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 20 client.4686 put_snap_realm 0x1 0x7f517000cad0 1 -> 0 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 10 client.4686 _put_inode deleting 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-04-25T10:35:18.587084+0000 mtime=2024-04-25T10:35:18.592380+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=4 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d1a0) 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 2 client.4686 _close_mds_session mds.0 seq 3 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 3) -- 0x55fa3aeb1b40 con 0x55fa3aea7cc0 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f518d909480 2 client.4686 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.598+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_caps(grant ino 0x10000000000 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 1031/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.592380+0000 ctime 2024-04-25T10:35:18.595034+0000 change_attr 4) ==== 260+0+0 (crc 0 0 0) 0x7f518005d040 con 0x55fa3aea7cc0 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.599+0000 7f5184bce640 10 client.4686 mds.0 seq now 4 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.599+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 4) -- 0x7f517000c8b0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.599+0000 7f5184bce640 5 client.4686 handle_caps don't have vino 0x10000000000.head op 0, immediately releasing 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.599+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_cap_release(3) -- 0x55fa3aeb1990 con 0x55fa3aea7cc0 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.599+0000 7f5184bce640 10 client.4686 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.599+0000 7f5184bce640 20 client.4686 trim_cache size 0 max 16384 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.599+0000 7f5184bce640 10 client.4686 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.675 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.602+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x7f517000c8b0 con 0x55fa3aea7cc0 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.602+0000 7f5184bce640 10 client.4686 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.602+0000 7f5184bce640 5 client.4686 _closed_mds_session mds.0 seq 4 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.602+0000 7f5184bce640 1 -- 172.21.15.103:0/246626647 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 msgr2=0x55fa3adff1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.602+0000 7f5184bce640 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea7cc0 0x55fa3adff1b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.602+0000 7f5184bce640 10 client.4686 remove_session_caps mds.0 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f5184bce640 10 client.4686 kick_requests_closed for mds.0 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f5184bce640 10 client.4686 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f5184bce640 20 client.4686 trim_cache size 0 max 16384 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f5184bce640 10 client.4686 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 2 client.4686 unmounted. 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 client.4686 shutdown 2024-04-25T10:35:18.676 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3aeb34c0 msgr2=0x55fa3aeb59a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.677 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3aeb34c0 0x55fa3aeb59a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.677 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 msgr2=0x55fa3aea4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.677 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 --2- 172.21.15.103:0/246626647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7a9c0 0x55fa3aea4f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5170004d60 tx=0x7f517c00d040 comp rx=0 tx=0).stop 2024-04-25T10:35:18.677 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f5187bd4640 1 -- 172.21.15.103:0/246626647 reap_dead start 2024-04-25T10:35:18.677 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 shutdown_connections 2024-04-25T10:35:18.677 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 >> 172.21.15.103:0/246626647 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.677 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 shutdown_connections 2024-04-25T10:35:18.678 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 1 -- 172.21.15.103:0/246626647 wait complete. 2024-04-25T10:35:18.678 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.603+0000 7f518d909480 20 client.4686 trim_cache size 0 max 16384 2024-04-25T10:35:18.678 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.LlreadvLlwritev (32 ms) 2024-04-25T10:35:18.678 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.LlreadvLlwritevNullContext 2024-04-25T10:35:18.702 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.604+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.604+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae0cb00 0x55fa3aeb2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3adffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb10f0 0x55fa3adff160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5170004a30 con 0x55fa3ae06650 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3adfec50 con 0x55fa3ae0cb00 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3adfee00 con 0x55fa3aeb10f0 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3adffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3adffb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39382/0 (socket says 172.21.15.103:39382) 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 -- 172.21.15.103:0/2722725436 learned_addr learned my addr 172.21.15.103:0/2722725436 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.703 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb10f0 0x55fa3adff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f51873d3640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae0cb00 0x55fa3aeb2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 -- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb10f0 msgr2=0x55fa3adff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb10f0 0x55fa3adff160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 -- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae0cb00 msgr2=0x55fa3aeb2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae0cb00 0x55fa3aeb2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 -- 172.21.15.103:0/2722725436 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae0d300 con 0x55fa3ae06650 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f51873d3640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae0cb00 0x55fa3aeb2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3adffb70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f517c024040 tx=0x7f517c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98af6a51e6475cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c03b080 con 0x55fa3ae06650 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f518d909480 10 client.4689 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517c040b40 con 0x55fa3ae06650 2024-04-25T10:35:18.704 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.605+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ad7add0 con 0x55fa3ae06650 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5175ffb640 20 client.4689 tick 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5175ffb640 20 client.4689 collect_and_send_metrics 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5175ffb640 20 client.4689 collect_and_send_global_metrics 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5175ffb640 5 client.4689 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5175ffb640 20 client.4689 trim_cache size 0 max 16384 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5175ffb640 20 client.4689 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c006450 con 0x55fa3ae06650 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c044020 con 0x55fa3ae06650 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5185bd0640 1 client.4689 handle_mds_map epoch 6 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f518d909480 20 client.4689 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f518d909480 10 client.4689 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f518d909480 20 client.4689 mds is 0 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f518d909480 10 client.4689 _open_mds_session mds.0 2024-04-25T10:35:18.705 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f518d909480 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb58f0 0x55fa3ae03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3aea4410 con 0x55fa3aeb58f0 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f518d909480 10 client.4689 waiting for session to mds.0 to open 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f51873d3640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb58f0 0x55fa3ae03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.606+0000 7f5185bd0640 10 client.4689 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.607+0000 7f51873d3640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb58f0 0x55fa3ae03b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe6933b4dfe2686b server_cookie=15629912a2d50e6f in_seq=0 out_seq=0 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3aea4410 con 0x55fa3aeb58f0 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f5185bd0640 10 client.4689 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f5185bd0640 10 client.4689 renew_caps mds.0 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c009cc0 con 0x55fa3aeb58f0 2024-04-25T10:35:18.706 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f5185bd0640 10 client.4689 connect_mds_targets for mds.0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f518d909480 10 client.4689 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f518d909480 20 client.4689 mds is 0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f518d909480 10 client.4689 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f518d909480 20 client.4689 encode_cap_releases enter (req: 0x55fa3aeaa0f0, mds: 0) 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f518d909480 20 client.4689 send_request set sent_stamp to 2024-04-25T10:35:18.609242+0000 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f518d909480 10 client.4689 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.606706+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.606706+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeaa460 con 0x55fa3aeb58f0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f518d909480 20 client.4689 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c009cc0 con 0x55fa3aeb58f0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.608+0000 7f5185bd0640 10 client.4689 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518007c040 con 0x55fa3aeb58f0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 insert_trace from 2024-04-25T10:35:18.609242+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 features 0xffffffffffffffff 2024-04-25T10:35:18.707 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 update_snap_trace len 70 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 get_snap_realm 0x1 0x7f515c009ee0, nref now is 1 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 15 client.4689 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 15 client.4689 snapc 1=[] 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 put_snap_realm 0x1 0x7f515c009ee0 2 -> 1 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c009fd0) - ctime 2024-04-25T10:35:18.595034+0000 mtime 2024-04-25T10:35:18.595034+0000 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 dir hash is 2 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 12 client.4689 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 2 2024-04-25T10:35:18.708 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 12 client.4689 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=- has_dir_layout 0x7f515c009fd0) caps pAsLsXsFs 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 get_snap_realm 0x1 0x7f515c009ee0, nref was 1 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 get_snap_realm 0x1 0x7f515c009ee0, nref now is 2 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 15 client.4689 add_update_cap first one, opened snaprealm 0x7f515c009ee0 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c009fd0) 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c009fd0) 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 put_snap_realm 0x1 0x7f515c009ee0 2 -> 1 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 lat 0.000359 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 _ll_get 0x7f515c009fd0 0x1 -> 1 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 2 client.4689 unmount 2024-04-25T10:35:18.709 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 1 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 1 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 unmounting: trim pass, size was 0+1 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 20 client.4689 trim_cache size 0 max 16384 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f5185bd0640 10 client.4689 unmounting: trim pass, size still 0+1 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 2 client.4689 unmounting 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 1 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 1 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 _ll_drop_pins 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 _ll_put 0x7f515c009fd0 0x1 1 -> 0 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 1 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 1 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) 2024-04-25T10:35:18.710 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 nothing to flush 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 1 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 1 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 flush_caps_sync 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 trim_cache size 0 max 16384 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) n = 8 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c009fd0) 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 15 client.4689 remove_cap last one, closing snaprealm 0x7f515c009ee0 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 20 client.4689 put_snap_realm 0x1 0x7f515c009ee0 1 -> 0 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 10 client.4689 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=- COMPLETE has_dir_layout 0x7f515c009fd0) 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 2 client.4689 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3aeb5d00 con 0x55fa3aeb58f0 2024-04-25T10:35:18.711 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.609+0000 7f518d909480 2 client.4689 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aeb5d00 con 0x55fa3aeb58f0 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 10 client.4689 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 5 client.4689 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 1 -- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb58f0 msgr2=0x55fa3ae03b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb58f0 0x55fa3ae03b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 10 client.4689 remove_session_caps mds.0 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 10 client.4689 kick_requests_closed for mds.0 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 10 client.4689 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 20 client.4689 trim_cache size 0 max 16384 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f5185bd0640 10 client.4689 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 2 client.4689 unmounted. 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 client.4689 shutdown 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 msgr2=0x55fa3adffb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.712 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3adffb70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f517c024040 tx=0x7f517c01a040 comp rx=0 tx=0).stop 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 shutdown_connections 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb58f0 0x55fa3ae03b20 unknown :-1 s=CLOSED pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb10f0 0x55fa3adff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3adffb70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 --2- 172.21.15.103:0/2722725436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae0cb00 0x55fa3aeb2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 >> 172.21.15.103:0/2722725436 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 shutdown_connections 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 -- 172.21.15.103:0/2722725436 wait complete. 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 20 client.4689 trim_cache size 0 max 16384 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.611+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.612+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.713 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb10f0 0x55fa3adffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb58f0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c008440 con 0x55fa3ae06650 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae10ad0 con 0x55fa3aeb10f0 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad7c100 con 0x55fa3aeb58f0 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39384/0 (socket says 172.21.15.103:39384) 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 -- 172.21.15.103:0/1670861243 learned_addr learned my addr 172.21.15.103:0/1670861243 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb10f0 0x55fa3adffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb58f0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 -- 172.21.15.103:0/1670861243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb58f0 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb58f0 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.714 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 -- 172.21.15.103:0/1670861243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb10f0 msgr2=0x55fa3adffb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb10f0 0x55fa3adffb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae03390 con 0x55fa3ae06650 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb58f0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51873d3640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51800213e0 tx=0x7f5180003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac50ddc730dfae77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518005e650 con 0x55fa3ae06650 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f518008cb60 con 0x55fa3ae06650 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f518d909480 10 client.4692 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae03730 con 0x55fa3ae06650 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51767fc640 20 client.4692 tick 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51767fc640 20 client.4692 collect_and_send_metrics 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51767fc640 20 client.4692 collect_and_send_global_metrics 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51767fc640 5 client.4692 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51767fc640 20 client.4692 trim_cache size 0 max 16384 2024-04-25T10:35:18.715 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f51767fc640 20 client.4692 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.613+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3aeb1990 con 0x55fa3ae06650 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066040 con 0x55fa3ae06650 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f5184bce640 1 client.4692 handle_mds_map epoch 6 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f518d909480 20 client.4692 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f518d909480 10 client.4692 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f518d909480 20 client.4692 mds is 0 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f518d909480 10 client.4692 _open_mds_session mds.0 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f518d909480 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3a60 0x55fa3aea3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aea3a60 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f518d909480 10 client.4692 waiting for session to mds.0 to open 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3a60 0x55fa3aea3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f5184bce640 10 client.4692 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.614+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3a60 0x55fa3aea3e70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c76f23d9057bc4c9 server_cookie=bc2a27bb76873ce6 in_seq=0 out_seq=0 2024-04-25T10:35:18.716 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aea3a60 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 renew_caps mds.0 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00a3c0 con 0x55fa3aea3a60 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 connect_mds_targets for mds.0 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 10 client.4692 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 mds is 0 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 10 client.4692 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 encode_cap_releases enter (req: 0x55fa3aeb06b0, mds: 0) 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 send_request set sent_stamp to 2024-04-25T10:35:18.616863+0000 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 10 client.4692 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.614566+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.614566+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae052b0 con 0x55fa3aea3a60 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 awaiting reply|forward|kick on 0x7ffc16ba7a90 2024-04-25T10:35:18.717 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00a3c0 con 0x55fa3aea3a60 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c018a30 con 0x55fa3aea3a60 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 insert_trace from 2024-04-25T10:35:18.616863+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 features 0xffffffffffffffff 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 update_snap_trace len 70 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref now is 1 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 15 client.4692 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 15 client.4692 snapc 1=[] 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.718 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 put_snap_realm 0x1 0x7f515c00a5e0 2 -> 1 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00a6d0) - ctime 2024-04-25T10:35:18.595034+0000 mtime 2024-04-25T10:35:18.595034+0000 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 dir hash is 2 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 12 client.4692 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 2 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 12 client.4692 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=- has_dir_layout 0x7f515c00a6d0) caps pAsLsXsFs 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref was 1 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref now is 2 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 15 client.4692 add_update_cap first one, opened snaprealm 0x7f515c00a5e0 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 10 client.4692 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 put_snap_realm 0x1 0x7f515c00a5e0 2 -> 1 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 handle_client_reply signalling caller 0x7ffc16ba7a90 2024-04-25T10:35:18.719 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 lat 0.000357 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 _ll_get 0x7f515c00a6d0 0x1 -> 1 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f5184bce640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 8 client.4692 _ll_create 0x1.head test_llreadvllwritevnullcontextfile43224 0666 578, uid 0, gid 0 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 10 client.4692 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0) dn 'test_llreadvllwritevnullcontextfile43224' 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 10 client.4692 _getattr mask As issued=1 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 3 client.4692 may_create 0x7f515c00a6d0 = 0 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 8 client.4692 _create(0x1 test_llreadvllwritevnullcontextfile43224, 0666) 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0) name test_llreadvllwritevnullcontextfile43224 2024-04-25T10:35:18.720 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 15 open_dir 0x55fa3aeb0bf0 on 0x7f515c00a6d0 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 15 client.4692 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0) 'test_llreadvllwritevnullcontextfile43224' dn 0x1.head["test_llreadvllwritevnullcontextfile43224"] (new dn) 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnullcontextfile43224 => 4275267050 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0) is_hash=1 hash=4275267050 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 10 client.4692 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 mds is 0 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 10 client.4692 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 encode_cap_releases enter (req: 0x55fa3ae055e0, mds: 0) 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 encode_dentry_release enter(dn:0x55fa3ad00b10) 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00a6d0), req:0x55fa3ae055e0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 send_request set sent_stamp to 2024-04-25T10:35:18.617348+0000 2024-04-25T10:35:18.721 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 10 client.4692 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnullcontextfile43224 2024-04-25T10:35:18.617306+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnullcontextfile43224 2024-04-25T10:35:18.617306+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae05a80 con 0x55fa3aea3a60 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.616+0000 7f518d909480 20 client.4692 awaiting reply|forward|kick on 0x7ffc16ba78e0 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 861+0+0 (crc 0 0 0) 0x7f517c017f00 con 0x55fa3aea3a60 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 insert_trace from 2024-04-25T10:35:18.617348+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 features 0xffffffffffffffff 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 update_snap_trace len 70 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref was 1 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref now is 2 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 hrm is_target=1 is_dentry=1 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) - ctime 2024-04-25T10:35:18.617306+0000 mtime 2024-04-25T10:35:18.617306+0000 2024-04-25T10:35:18.722 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 12 client.4692 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 12 client.4692 add_update_inode adding 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref was 2 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref now is 3 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 15 client.4692 add_update_cap first one, opened snaprealm 0x7f515c00a5e0 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 12 client.4692 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) caps pAsLsXs 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.595034+0000 ctime=2024-04-25T10:35:18.595034+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) pAsLsXs ctime 2024-04-25T10:35:18.617306+0000 mtime 2024-04-25T10:35:18.617306+0000 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 dir hash is 2 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 12 client.4692 add_update_inode client inode change_attr: 2 , mds inodestat change_attr: 3 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 12 client.4692 insert_dentry_inode 'test_llreadvllwritevnullcontextfile43224' vino 0x10000000001.head in dir 0x1.head dn 0x55fa3ad00b10 2024-04-25T10:35:18.723 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 15 client.4692 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 'test_llreadvllwritevnullcontextfile43224' to inode 0x7f515c00acb0 dn 0x1.head["test_llreadvllwritevnullcontextfile43224"] (old dn) 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 link inode 0x7f515c00acb0 parents now 0x1.head["test_llreadvllwritevnullcontextfile43224"] 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 15 client.4692 update_dentry_lease 0x1.head["test_llreadvllwritevnullcontextfile43224"] lease(mask 7 dur 30000) from 2024-04-25T10:35:18.617348+0000 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 10 client.4692 got dentry lease on test_llreadvllwritevnullcontextfile43224 dur 30000ms ttl 2024-04-25T10:35:48.617348+0000 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 put_snap_realm 0x1 0x7f515c00a5e0 3 -> 2 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 handle_client_reply signalling caller 0x7ffc16ba78e0 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f5184bce640 20 client.4692 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f518d909480 20 client.4692 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f518d909480 10 client.4692 delegated_inos: [] 2024-04-25T10:35:18.724 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f518d909480 10 client.4692 make_request created ino 0x10000000001 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f518d909480 20 client.4692 make_request target is 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f518d909480 20 client.4692 lat 0.005113 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.621+0000 7f518d909480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 10 client.4692 _create_fh 0x10000000001 mode 3 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 20 client.4692 trim_cache size 1 max 16384 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 8 client.4692 create(#0x1/test_llreadvllwritevnullcontextfile43224, 0100666 layout 0 0 0) = 0 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 20 client.4692 _ll_create created = 1 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 8 client.4692 _ll_create 0x1.head test_llreadvllwritevnullcontextfile43224 0666 578 = 0 (0x55fa3ad7efb0 10000000001) 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 20 client.4692 _ll_get 0x7f515c00acb0 0x10000000001 -> 1 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 10 client.4692 fill_statx on 0x10000000001 snap/devhead mode 0100666 mtime 2024-04-25T10:35:18.617306+0000 ctime 2024-04-25T10:35:18.617306+0000 change_attr 0 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.725 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 10 client.4692 get_quota_root realm 0x1 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 10 client.4692 get_quota_root 0x10000000001.head -> 0x1.head 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 10 client.4692 cur file size is 0 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf58f0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- osd_op(unknown.0.0:1 3.7 3:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x55fa3aeb94e0 con 0x55fa3adf58f0 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- osd_op(unknown.0.0:2 3.7 3:e2e07930:::10000000001.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x55fa3aeb9d30 con 0x55fa3adf58f0 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f5184bce640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f5184bce640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf58f0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf58f0 0x55fa3aeb8fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=f671e5e38593ad30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f5184bce640 10 client.4692 ms_handle_connect on v2:172.21.15.103:6824/2287324132 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.622+0000 7f5187bd4640 1 -- 172.21.15.103:0/1670861243 <== osd.3 v2:172.21.15.103:6824/2287324132 1 ==== osd_op_reply(1 10000000001.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3adf58f0 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f5187bd4640 1 -- 172.21.15.103:0/1670861243 <== osd.3 v2:172.21.15.103:6824/2287324132 2 ==== osd_op_reply(2 10000000001.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3adf58f0 2024-04-25T10:35:18.726 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 client.4692 wanted_max_size 0 -> 14 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 client.4692 get_caps 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 20 client.4692 clear_suid_sgid 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 client.4692 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 5 client.4692 get_cap_ref got first FILE_BUFFER ref on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 5 client.4692 get_cap_ref got first FILE_CACHE ref on 0x10000000001.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={4=0,1024=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 mark_caps_dirty 0x10000000001.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) - -> Fw 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 client.4692 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 client.4692 get_quota_root realm 0x1 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 client.4692 get_quota_root 0x10000000001.head -> 0x1.head 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 7 client.4692 wrote to 14, extending file size 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 mark_caps_dirty 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) Fw -> Fw 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 client.4692 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 3 client.4692 pwritev(0x55fa3ad7efb0, "...", 14, 0) = 14 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.623+0000 7f518d909480 10 client.4692 get_caps 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-25T10:35:18.727 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 _read_async 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 0~14 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 3 client.4692 preadv(0x55fa3ad7efb0, 0) = 14 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 3 client.4692 ll_release (fh)0x55fa3ad7efb0 0x10000000001 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 8 client.4692 _release_fh 0x55fa3ad7efb0 mode 3 on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 _flush 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- osd_op(unknown.0.0:3 3.7 3:e2e07930:::10000000001.00000000:head [write 0~14 in=14b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x55fa3aeba0d0 con 0x55fa3adf58f0 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 check_caps on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 delaying cap release 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 _release_fh 0x55fa3ad7efb0 on inode 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) no async_err state 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.728 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 3 client.4692 ll_unlink 0x1.head test_llreadvllwritevnullcontextfile43224 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0); ; name test_llreadvllwritevnullcontextfile43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 _getattr mask As issued=1 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 3 client.4692 may_delete 0x7f515c00a6d0 = 0 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 8 client.4692 _unlink(0x1 test_llreadvllwritevnullcontextfile43224 uid 0 gid 0) 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) name test_llreadvllwritevnullcontextfile43224 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 _lookup have 0x1.head["test_llreadvllwritevnullcontextfile43224"] from mds.0 ttl 2024-04-25T10:35:48.617348+0000 seq 2 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) test_llreadvllwritevnullcontextfile43224 = 0x10000000001.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnullcontextfile43224 => 4275267050 2024-04-25T10:35:18.729 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) is_hash=1 hash=4275267050 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 choose_target_mds from dirfragtree hash 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 mds is 0 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 encode_cap_releases enter (req: 0x55fa3aeba470, mds: 0) 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 encode_inode_release enter(in:0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0), req:0x55fa3aeba470 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 encode_dentry_release enter(dn:0x55fa3ad00b10) 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0), req:0x55fa3aeba470 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 send_request set sent_stamp to 2024-04-25T10:35:18.624674+0000 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 10 client.4692 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevnullcontextfile43224 2024-04-25T10:35:18.624631+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevnullcontextfile43224 2024-04-25T10:35:18.624631+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeba7a0 con 0x55fa3aea3a60 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f518d909480 20 client.4692 awaiting reply|forward|kick on 0x7ffc16ba7ab0 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_caps(revoke ino 0x10000000001 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.617306+0000 ctime 2024-04-25T10:35:18.617306+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c02f070 con 0x55fa3aea3a60 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 5 client.4692 set_cap_epoch_barrier epoch = 20 2024-04-25T10:35:18.730 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 mds.0 seq now 1 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 5 client.4692 handle_cap_grant on in 0x10000000001 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:18.617306+0000 mtime 2024-04-25T10:35:18.617306+0000 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 revocation of AxXx 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 check_caps on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 completed revocation of AxXx 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 mark_caps_flushing Fw 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 mark_caps_clean 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 send_cap 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 15 client.4692 auth cap, requesting max_size 14 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000001 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 14/14 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.624477+0000 ctime 2024-04-25T10:35:18.624477+0000 change_attr 1) -- 0x7f515c00b290 con 0x55fa3aea3a60 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.624+0000 7f5184bce640 10 client.4692 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5187bd4640 1 -- 172.21.15.103:0/1670861243 <== osd.3 v2:172.21.15.103:6824/2287324132 3 ==== osd_op_reply(3 10000000001.00000000 [write 0~14] v22'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3adf58f0 2024-04-25T10:35:18.731 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f51777fe640 10 client.4692 _flushed 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f51777fe640 5 client.4692 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f51777fe640 5 client.4692 put_cap_ref dropped last FILE_CACHE ref on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f51777fe640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) n = 2 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f51777fe640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile43224"] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 509+0+0 (crc 0 0 0) 0x7f517c030430 con 0x55fa3aea3a60 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 handle_client_reply got a reply. Safe:0 tid 3 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 10 client.4692 insert_trace from 2024-04-25T10:35:18.624674+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 10 client.4692 features 0xffffffffffffffff 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 10 client.4692 update_snap_trace len 70 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref was 2 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 get_snap_realm 0x1 0x7f515c00a5e0, nref now is 3 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 10 client.4692 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 10 client.4692 hrm is_target=0 is_dentry=1 2024-04-25T10:35:18.732 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 12 client.4692 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) caps pAsLsXs 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 10 client.4692 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.617306+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) pAsLsXs ctime 2024-04-25T10:35:18.624631+0000 mtime 2024-04-25T10:35:18.617306+0000 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 dir hash is 2 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 12 client.4692 add_update_inode client inode change_attr: 3 , mds inodestat change_attr: 4 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 10 client.4692 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 15 client.4692 unlink dir 0x7f515c00a6d0 'test_llreadvllwritevnullcontextfile43224' dn 0x55fa3ad00b10 inode 0x7f515c00acb0 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 unlink inode 0x7f515c00acb0 parents now 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 15 client.4692 update_dentry_lease 0x1.head["test_llreadvllwritevnullcontextfile43224"] lease(mask 3 dur 30000) from 2024-04-25T10:35:18.624674+0000 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 10 client.4692 got dentry lease on test_llreadvllwritevnullcontextfile43224 dur 30000ms ttl 2024-04-25T10:35:48.624674+0000 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 put_snap_realm 0x1 0x7f515c00a5e0 3 -> 2 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 handle_client_reply signalling caller 0x7ffc16ba7ab0 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f5184bce640 20 client.4692 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.733 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 20 client.4692 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 20 client.4692 lat 0.001332 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 20 client.4692 trim_cache size 1 max 16384 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 8 client.4692 unlink(#0x1/test_llreadvllwritevnullcontextfile43224) = 0 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 2 client.4692 unmount 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 2 client.4692 unmounting 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3adf4f30 con 0x55fa3aea3a60 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.625+0000 7f518d909480 10 client.4692 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_caps(grant ino 0x10000000001 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=LsFxcb follows 0 size 14/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.624477+0000 ctime 2024-04-25T10:35:18.624631+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f515c00b290 con 0x55fa3aea3a60 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 mds.0 seq now 2 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 5 client.4692 handle_cap_grant on in 0x10000000001 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFsxcrwb 2024-04-25T10:35:18.734 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624477+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) pAsXsFsxcrwb ctime 2024-04-25T10:35:18.624631+0000 mtime 2024-04-25T10:35:18.624477+0000 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 grant, new caps are Ls 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 5 client.4692 _try_to_trim_inode in 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 20 client.4692 trim_cache size 1 max 16384 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 unmounting: trim pass, size still 1+2 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f517c030620 con 0x55fa3aea3a60 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 20 client.4692 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 insert_trace from 2024-04-25T10:35:18.624674+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 20 client.4692 trim_cache size 1 max 16384 2024-04-25T10:35:18.735 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 15 client.4692 trim_dentry unlinking dn test_llreadvllwritevnullcontextfile43224 in dir 0x1 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 15 client.4692 unlink dir 0x7f515c00a6d0 'test_llreadvllwritevnullcontextfile43224' dn 0x55fa3ad00b10 inode 0 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 15 client.4692 unlink removing 'test_llreadvllwritevnullcontextfile43224' dn 0x55fa3ad00b10 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 15 client.4692 close_dir dir 0x55fa3aeb0bf0 on 0x7f515c00a6d0 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _ll_drop_pins 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 _ll_put 0x7f515c00acb0 0x10000000001 1 -> 0 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 _ll_put 0x7f515c00a6d0 0x1 2 -> 0 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.736 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 _release 0x10000000001.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _invalidate_inode_cache 0x10000000001.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00acb0) 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _flush 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 nothing to flush 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 nothing to flush 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 1 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 flush_caps_sync 2024-04-25T10:35:18.737 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 waiting on mds.0 tid 2 (want 2) 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_caps(flush_ack ino 0x10000000001 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c0309d0 con 0x55fa3aea3a60 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 mds.0 seq now 3 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 5 client.4692 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) with Fw 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 5 client.4692 flushing_caps Fw -> - 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) !flushing 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 20 client.4692 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) n = 1 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 unmounting: trim pass, size was 0+2 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 20 client.4692 trim_cache size 0 max 16384 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f5184bce640 10 client.4692 unmounting: trim pass, size still 0+2 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 trim_cache size 0 max 16384 2024-04-25T10:35:18.738 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) n = 11 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 15 client.4692 remove_cap last one, closing snaprealm 0x7f515c00a5e0 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_snap_realm 0x1 0x7f515c00a5e0 2 -> 1 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.617306+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=- COMPLETE has_dir_layout 0x7f515c00a6d0) 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) n = 18 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 remove_cap mds.0 on 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 15 client.4692 remove_cap last one, closing snaprealm 0x7f515c00a5e0 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 20 client.4692 put_snap_realm 0x1 0x7f515c00a5e0 1 -> 0 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 10 client.4692 _put_inode deleting 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-04-25T10:35:18.617306+0000 mtime=2024-04-25T10:35:18.624477+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=1 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00acb0) 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 2 client.4692 _close_mds_session mds.0 seq 3 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 3) -- 0x55fa3adf3f20 con 0x55fa3aea3a60 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.629+0000 7f518d909480 2 client.4692 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.739 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adf3f20 con 0x55fa3aea3a60 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 10 client.4692 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 5 client.4692 _closed_mds_session mds.0 seq 3 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 1 -- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3a60 msgr2=0x55fa3aea3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3a60 0x55fa3aea3e70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 10 client.4692 remove_session_caps mds.0 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 10 client.4692 kick_requests_closed for mds.0 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 10 client.4692 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 20 client.4692 trim_cache size 0 max 16384 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f5184bce640 10 client.4692 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f518d909480 2 client.4692 unmounted. 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f518d909480 1 client.4692 shutdown 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.633+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf58f0 msgr2=0x55fa3aeb8fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf58f0 0x55fa3aeb8fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 msgr2=0x55fa3ae03b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.740 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 1 --2- 172.21.15.103:0/1670861243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51800213e0 tx=0x7f5180003020 comp rx=0 tx=0).stop 2024-04-25T10:35:18.741 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f5187bd4640 1 -- 172.21.15.103:0/1670861243 reap_dead start 2024-04-25T10:35:18.741 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 shutdown_connections 2024-04-25T10:35:18.741 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 >> 172.21.15.103:0/1670861243 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.741 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 shutdown_connections 2024-04-25T10:35:18.741 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 1 -- 172.21.15.103:0/1670861243 wait complete. 2024-04-25T10:35:18.741 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 20 client.4692 trim_cache size 0 max 16384 2024-04-25T10:35:18.741 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.LlreadvLlwritevNullContext (31 ms) 2024-04-25T10:35:18.741 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.LlreadvLlwritevOPathFileHandle 2024-04-25T10:35:18.762 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.634+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.762 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.635+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.762 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.635+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.762 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.635+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.762 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.635+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c004e60 con 0x55fa3ae06650 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae0cc80 con 0x55fa3aea4800 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeb06b0 con 0x55fa3ad39910 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39396/0 (socket says 172.21.15.103:39396) 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 -- 172.21.15.103:0/80186013 learned_addr learned my addr 172.21.15.103:0/80186013 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f51873d3640 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5187bd4640 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 -- 172.21.15.103:0/80186013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad39910 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 -- 172.21.15.103:0/80186013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 -- 172.21.15.103:0/80186013 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ad7a360 con 0x55fa3ae06650 2024-04-25T10:35:18.763 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5186bd2640 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f517c006ae0 tx=0x7f517c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b981ecc01bb7bc9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c04e020 con 0x55fa3ae06650 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517c030430 con 0x55fa3ae06650 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f518d909480 10 client.4695 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aeb8400 con 0x55fa3ae06650 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5175ffb640 20 client.4695 tick 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5175ffb640 20 client.4695 collect_and_send_metrics 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5175ffb640 20 client.4695 collect_and_send_global_metrics 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5175ffb640 5 client.4695 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5175ffb640 20 client.4695 trim_cache size 0 max 16384 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5175ffb640 20 client.4695 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c0066f0 con 0x55fa3ae06650 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c044040 con 0x55fa3ae06650 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.636+0000 7f5185bd0640 1 client.4695 handle_mds_map epoch 6 2024-04-25T10:35:18.764 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f518d909480 20 client.4695 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f518d909480 10 client.4695 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f518d909480 20 client.4695 mds is 0 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f518d909480 10 client.4695 _open_mds_session mds.0 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f518d909480 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7ea40 0x55fa3ad7f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3ad7ea40 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f518d909480 10 client.4695 waiting for session to mds.0 to open 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f51873d3640 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7ea40 0x55fa3ad7f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f5185bd0640 10 client.4695 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.637+0000 7f51873d3640 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7ea40 0x55fa3ad7f350 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb45a1e363fb9742 server_cookie=cdb90ebdaa0c9ec9 in_seq=0 out_seq=0 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3ad7ea40 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 renew_caps mds.0 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00a7f0 con 0x55fa3ad7ea40 2024-04-25T10:35:18.765 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 connect_mds_targets for mds.0 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 mds is 0 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 encode_cap_releases enter (req: 0x55fa3aeab870, mds: 0) 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 send_request set sent_stamp to 2024-04-25T10:35:18.642912+0000 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.637530+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.637530+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adffcc0 con 0x55fa3ad7ea40 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00a7f0 con 0x55fa3ad7ea40 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518001ce60 con 0x55fa3ad7ea40 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.766 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 insert_trace from 2024-04-25T10:35:18.642912+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 features 0xffffffffffffffff 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 update_snap_trace len 70 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 get_snap_realm 0x1 0x7f515c00aa10, nref now is 1 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 15 client.4695 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 15 client.4695 snapc 1=[] 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 put_snap_realm 0x1 0x7f515c00aa10 2 -> 1 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00ab00) - ctime 2024-04-25T10:35:18.624631+0000 mtime 2024-04-25T10:35:18.624631+0000 2024-04-25T10:35:18.767 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 dir hash is 2 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 12 client.4695 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 4 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 12 client.4695 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=- has_dir_layout 0x7f515c00ab00) caps pAsLsXsFs 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 get_snap_realm 0x1 0x7f515c00aa10, nref was 1 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 get_snap_realm 0x1 0x7f515c00aa10, nref now is 2 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 15 client.4695 add_update_cap first one, opened snaprealm 0x7f515c00aa10 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00ab00) 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00ab00) 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 put_snap_realm 0x1 0x7f515c00aa10 2 -> 1 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 lat 0.000494 2024-04-25T10:35:18.768 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 _ll_get 0x7f515c00ab00 0x1 -> 1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 2 client.4695 unmount 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 unmounting: trim pass, size was 0+1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 20 client.4695 trim_cache size 0 max 16384 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f5185bd0640 10 client.4695 unmounting: trim pass, size still 0+1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 2 client.4695 unmounting 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 _ll_drop_pins 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 _ll_put 0x7f515c00ab00 0x1 1 -> 0 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 1 2024-04-25T10:35:18.769 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 nothing to flush 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 1 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 1 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 flush_caps_sync 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.642+0000 7f518d909480 10 client.4695 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 20 client.4695 trim_cache size 0 max 16384 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 10 client.4695 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) n = 8 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 10 client.4695 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ab00) 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 15 client.4695 remove_cap last one, closing snaprealm 0x7f515c00aa10 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 20 client.4695 put_snap_realm 0x1 0x7f515c00aa10 1 -> 0 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 10 client.4695 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=- COMPLETE has_dir_layout 0x7f515c00ab00) 2024-04-25T10:35:18.770 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 2 client.4695 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3adffe70 con 0x55fa3ad7ea40 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.643+0000 7f518d909480 2 client.4695 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adffe70 con 0x55fa3ad7ea40 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f5185bd0640 10 client.4695 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f5185bd0640 5 client.4695 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f5185bd0640 1 -- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7ea40 msgr2=0x55fa3ad7f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f5185bd0640 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7ea40 0x55fa3ad7f350 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f5185bd0640 10 client.4695 remove_session_caps mds.0 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f5185bd0640 10 client.4695 kick_requests_closed for mds.0 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 2 client.4695 unmounted. 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 client.4695 shutdown 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 msgr2=0x55fa3ae03b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f517c006ae0 tx=0x7f517c01e000 comp rx=0 tx=0).stop 2024-04-25T10:35:18.771 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 shutdown_connections 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7ea40 0x55fa3ad7f350 unknown :-1 s=CLOSED pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 --2- 172.21.15.103:0/80186013 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 >> 172.21.15.103:0/80186013 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 shutdown_connections 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 -- 172.21.15.103:0/80186013 wait complete. 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 20 client.4695 trim_cache size 0 max 16384 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.647+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.648+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.648+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.648+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7ea40 0x55fa3ae03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.648+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae06650 0x55fa3adfe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.772 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.648+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c0095e0 con 0x55fa3ad39910 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.648+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad7b420 con 0x55fa3ae06650 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.648+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad7b5d0 con 0x55fa3ad7ea40 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39406/0 (socket says 172.21.15.103:39406) 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 -- 172.21.15.103:0/833121065 learned_addr learned my addr 172.21.15.103:0/833121065 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 -- 172.21.15.103:0/833121065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7ea40 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7ea40 0x55fa3ae03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 -- 172.21.15.103:0/833121065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae06650 msgr2=0x55fa3adfe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae06650 0x55fa3adfe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aeb85d0 con 0x55fa3ad39910 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51873d3640 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55fa3ae10aa0 tx=0x55fa3ae04f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03b98bc9065f1a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180093080 con 0x55fa3ad39910 2024-04-25T10:35:18.773 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5180000bc0 con 0x55fa3ad39910 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 10 client.4698 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aeb87a0 con 0x55fa3ad39910 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51767fc640 20 client.4698 tick 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51767fc640 20 client.4698 collect_and_send_metrics 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51767fc640 20 client.4698 collect_and_send_global_metrics 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51767fc640 5 client.4698 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51767fc640 20 client.4698 trim_cache size 0 max 16384 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f51767fc640 20 client.4698 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3ac77d50 con 0x55fa3ad39910 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066040 con 0x55fa3ad39910 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f5184bce640 1 client.4698 handle_mds_map epoch 6 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 20 client.4698 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 10 client.4698 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 20 client.4698 mds is 0 2024-04-25T10:35:18.774 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 10 client.4698 _open_mds_session mds.0 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adf7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aea4800 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.649+0000 7f518d909480 10 client.4698 waiting for session to mds.0 to open 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.650+0000 7f5186bd2640 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adf7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.650+0000 7f5184bce640 10 client.4698 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.650+0000 7f5186bd2640 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adf7170 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86d8dc61f3783031 server_cookie=d043b04b56cafe71 in_seq=0 out_seq=0 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aea4800 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 renew_caps mds.0 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00a770 con 0x55fa3aea4800 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 connect_mds_targets for mds.0 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 10 client.4698 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 mds is 0 2024-04-25T10:35:18.775 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 10 client.4698 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 encode_cap_releases enter (req: 0x55fa3ad7afa0, mds: 0) 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 send_request set sent_stamp to 2024-04-25T10:35:18.653023+0000 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 10 client.4698 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.650416+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.650416+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb7910 con 0x55fa3aea4800 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 awaiting reply|forward|kick on 0x7ffc16ba7a90 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00a770 con 0x55fa3aea4800 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c036040 con 0x55fa3aea4800 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 insert_trace from 2024-04-25T10:35:18.653023+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 features 0xffffffffffffffff 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 update_snap_trace len 70 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.776 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref now is 1 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 15 client.4698 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 15 client.4698 snapc 1=[] 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 put_snap_realm 0x1 0x7f515c00a990 2 -> 1 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00aa80) - ctime 2024-04-25T10:35:18.624631+0000 mtime 2024-04-25T10:35:18.624631+0000 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 dir hash is 2 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 12 client.4698 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 4 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 12 client.4698 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=- has_dir_layout 0x7f515c00aa80) caps pAsLsXsFs 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref was 1 2024-04-25T10:35:18.777 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref now is 2 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 15 client.4698 add_update_cap first one, opened snaprealm 0x7f515c00a990 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 10 client.4698 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 put_snap_realm 0x1 0x7f515c00a990 2 -> 1 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 handle_client_reply signalling caller 0x7ffc16ba7a90 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 lat 0.000374 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 _ll_get 0x7f515c00aa80 0x1 -> 1 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f5184bce640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 8 client.4698 _ll_create 0x1.head test_llreadvllwritevopathfilehandlefile43224 0666 66, uid 0, gid 0 2024-04-25T10:35:18.778 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 10 client.4698 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80) dn 'test_llreadvllwritevopathfilehandlefile43224' 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 10 client.4698 _getattr mask As issued=1 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 3 client.4698 may_create 0x7f515c00aa80 = 0 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 8 client.4698 _create(0x1 test_llreadvllwritevopathfilehandlefile43224, 0666) 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80) name test_llreadvllwritevopathfilehandlefile43224 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 15 open_dir 0x55fa3adf7b00 on 0x7f515c00aa80 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 15 client.4698 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80) 'test_llreadvllwritevopathfilehandlefile43224' dn 0x1.head["test_llreadvllwritevopathfilehandlefile43224"] (new dn) 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 choose_target_mds inode dir hash is 2 on test_llreadvllwritevopathfilehandlefile43224 => 4282066634 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80) is_hash=1 hash=4282066634 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 10 client.4698 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 20 client.4698 mds is 0 2024-04-25T10:35:18.779 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.652+0000 7f518d909480 10 client.4698 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.653+0000 7f518d909480 20 client.4698 encode_cap_releases enter (req: 0x55fa3aeb7c40, mds: 0) 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.653+0000 7f518d909480 20 client.4698 encode_dentry_release enter(dn:0x7f517000cad0) 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.653+0000 7f518d909480 20 client.4698 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aa80), req:0x55fa3aeb7c40 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.653+0000 7f518d909480 20 client.4698 send_request set sent_stamp to 2024-04-25T10:35:18.653504+0000 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.653+0000 7f518d909480 10 client.4698 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevopathfilehandlefile43224 2024-04-25T10:35:18.653467+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.653+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevopathfilehandlefile43224 2024-04-25T10:35:18.653467+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb8120 con 0x55fa3aea4800 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.653+0000 7f518d909480 20 client.4698 awaiting reply|forward|kick on 0x7ffc16ba78e0 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 865+0+0 (crc 0 0 0) 0x7f517c04f060 con 0x55fa3aea4800 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 insert_trace from 2024-04-25T10:35:18.653504+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 features 0xffffffffffffffff 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 update_snap_trace len 70 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref was 1 2024-04-25T10:35:18.780 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref now is 2 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 hrm is_target=1 is_dentry=1 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) - ctime 2024-04-25T10:35:18.653467+0000 mtime 2024-04-25T10:35:18.653467+0000 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 12 client.4698 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 12 client.4698 add_update_inode adding 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref was 2 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref now is 3 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 15 client.4698 add_update_cap first one, opened snaprealm 0x7f515c00a990 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 12 client.4698 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) caps pAsLsXs 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.624631+0000 ctime=2024-04-25T10:35:18.624631+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) pAsLsXs ctime 2024-04-25T10:35:18.653467+0000 mtime 2024-04-25T10:35:18.653467+0000 2024-04-25T10:35:18.781 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 dir hash is 2 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 12 client.4698 add_update_inode client inode change_attr: 4 , mds inodestat change_attr: 5 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 12 client.4698 insert_dentry_inode 'test_llreadvllwritevopathfilehandlefile43224' vino 0x10000000002.head in dir 0x1.head dn 0x7f517000cad0 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 15 client.4698 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 'test_llreadvllwritevopathfilehandlefile43224' to inode 0x7f515c00b060 dn 0x1.head["test_llreadvllwritevopathfilehandlefile43224"] (old dn) 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 link inode 0x7f515c00b060 parents now 0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 15 client.4698 update_dentry_lease 0x1.head["test_llreadvllwritevopathfilehandlefile43224"] lease(mask 7 dur 30000) from 2024-04-25T10:35:18.653504+0000 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 got dentry lease on test_llreadvllwritevopathfilehandlefile43224 dur 30000ms ttl 2024-04-25T10:35:48.653504+0000 2024-04-25T10:35:18.782 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 put_snap_realm 0x1 0x7f515c00a990 3 -> 2 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 handle_client_reply signalling caller 0x7ffc16ba78e0 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 delegated_inos: [] 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 make_request created ino 0x10000000002 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 make_request target is 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 lat 0.002504 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 _create_fh 0x10000000002 mode 3 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 trim_cache size 1 max 16384 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 8 client.4698 create(#0x1/test_llreadvllwritevopathfilehandlefile43224, 0100666 layout 0 0 0) = 0 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 _ll_create created = 1 2024-04-25T10:35:18.783 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 8 client.4698 _ll_create 0x1.head test_llreadvllwritevopathfilehandlefile43224 0666 66 = 0 (0x55fa3ad7efb0 10000000002) 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 _ll_get 0x7f515c00b060 0x10000000002 -> 1 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 fill_statx on 0x10000000002 snap/devhead mode 0100666 mtime 2024-04-25T10:35:18.653467+0000 ctime 2024-04-25T10:35:18.653467+0000 change_attr 0 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 3 client.4698 ll_release (fh)0x55fa3ad7efb0 0x10000000002 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 8 client.4698 _release_fh 0x55fa3ad7efb0 mode 3 on 0x10000000002.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 _flush 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 nothing to flush 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 check_caps on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 delaying cap release 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 cap_delay_requeue on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.784 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 _release_fh 0x55fa3ad7efb0 on inode 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) no async_err state 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 3 client.4698 ll_unlink 0x1.head test_llreadvllwritevopathfilehandlefile43224 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80); ; name test_llreadvllwritevopathfilehandlefile43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 _getattr mask As issued=1 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 3 client.4698 may_delete 0x7f515c00aa80 = 0 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 8 client.4698 _unlink(0x1 test_llreadvllwritevopathfilehandlefile43224 uid 0 gid 0) 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) name test_llreadvllwritevopathfilehandlefile43224 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 _lookup have 0x1.head["test_llreadvllwritevopathfilehandlefile43224"] from mds.0 ttl 2024-04-25T10:35:48.653504+0000 seq 2 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) test_llreadvllwritevopathfilehandlefile43224 = 0x10000000002.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 choose_target_mds inode dir hash is 2 on test_llreadvllwritevopathfilehandlefile43224 => 4282066634 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) is_hash=1 hash=4282066634 2024-04-25T10:35:18.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 choose_target_mds from dirfragtree hash 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 mds is 0 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 encode_cap_releases enter (req: 0x55fa3aeb8120, mds: 0) 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 encode_inode_release enter(in:0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060), req:0x55fa3aeb8120 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 encode_dentry_release enter(dn:0x7f517000cad0) 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80), req:0x55fa3aeb8120 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 send_request set sent_stamp to 2024-04-25T10:35:18.656222+0000 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 10 client.4698 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevopathfilehandlefile43224 2024-04-25T10:35:18.656186+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevopathfilehandlefile43224 2024-04-25T10:35:18.656186+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb8530 con 0x55fa3aea4800 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f518d909480 20 client.4698 awaiting reply|forward|kick on 0x7ffc16ba7ab0 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_caps(revoke ino 0x10000000002 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.653467+0000 ctime 2024-04-25T10:35:18.653467+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c030430 con 0x55fa3aea4800 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 5 client.4698 set_cap_epoch_barrier epoch = 20 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 mds.0 seq now 1 2024-04-25T10:35:18.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 5 client.4698 handle_cap_grant on in 0x10000000002 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:18.653467+0000 mtime 2024-04-25T10:35:18.653467+0000 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 revocation of AxXx 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.655+0000 7f5184bce640 10 client.4698 check_caps on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) wanted - used - issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 completed revocation of AxXx 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 send_cap 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile43224"] 0x7f515c00b060) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsxFsxcrwb revoking AxXx dropping Fxcrwb 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 15 client.4698 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000002 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.653467+0000 ctime 2024-04-25T10:35:18.653467+0000 change_attr 0) -- 0x7f515c00b640 con 0x55fa3aea4800 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 513+0+0 (crc 0 0 0) 0x7f517c018a30 con 0x55fa3aea4800 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 handle_client_reply got a reply. Safe:0 tid 3 2024-04-25T10:35:18.787 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 insert_trace from 2024-04-25T10:35:18.656222+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 features 0xffffffffffffffff 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 update_snap_trace len 70 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref was 2 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 get_snap_realm 0x1 0x7f515c00a990, nref now is 3 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 hrm is_target=0 is_dentry=1 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 12 client.4698 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) caps pAsLsXs 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) pAsLsXs ctime 2024-04-25T10:35:18.656186+0000 mtime 2024-04-25T10:35:18.653467+0000 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 dir hash is 2 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 12 client.4698 add_update_inode client inode change_attr: 5 , mds inodestat change_attr: 6 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 15 client.4698 unlink dir 0x7f515c00aa80 'test_llreadvllwritevopathfilehandlefile43224' dn 0x7f517000cad0 inode 0x7f515c00b060 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.788 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 unlink inode 0x7f515c00b060 parents now 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 15 client.4698 update_dentry_lease 0x1.head["test_llreadvllwritevopathfilehandlefile43224"] lease(mask 3 dur 30000) from 2024-04-25T10:35:18.656222+0000 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 got dentry lease on test_llreadvllwritevopathfilehandlefile43224 dur 30000ms ttl 2024-04-25T10:35:48.656222+0000 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 put_snap_realm 0x1 0x7f515c00a990 3 -> 2 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 handle_client_reply signalling caller 0x7ffc16ba7ab0 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 20 client.4698 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 20 client.4698 lat 0.001123 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 20 client.4698 trim_cache size 1 max 16384 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 8 client.4698 unlink(#0x1/test_llreadvllwritevopathfilehandlefile43224) = 0 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 2 client.4698 unmount 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.789 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 20 client.4698 trim_cache size 1 max 16384 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size still 1+2 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 2 client.4698 unmounting 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3adf7cc0 con 0x55fa3aea4800 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.656+0000 7f518d909480 10 client.4698 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_caps(grant ino 0x10000000002 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.653467+0000 ctime 2024-04-25T10:35:18.656186+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f515c00b640 con 0x55fa3aea4800 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 mds.0 seq now 2 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 5 client.4698 handle_cap_grant on in 0x10000000002 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.653467+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) pAsXsFs ctime 2024-04-25T10:35:18.656186+0000 mtime 2024-04-25T10:35:18.653467+0000 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 max_size 4194304 -> 0 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 grant, new caps are LsFxcrwb 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 5 client.4698 _try_to_trim_inode in 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 20 client.4698 trim_cache size 1 max 16384 2024-04-25T10:35:18.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size still 1+2 2024-04-25T10:35:18.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f517c000bc0 con 0x55fa3aea4800 2024-04-25T10:35:18.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:18.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 insert_trace from 2024-04-25T10:35:18.656222+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:18.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:18.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 20 client.4698 trim_cache size 1 max 16384 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 15 client.4698 trim_dentry unlinking dn test_llreadvllwritevopathfilehandlefile43224 in dir 0x1 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 15 client.4698 unlink dir 0x7f515c00aa80 'test_llreadvllwritevopathfilehandlefile43224' dn 0x7f517000cad0 inode 0 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 15 client.4698 unlink removing 'test_llreadvllwritevopathfilehandlefile43224' dn 0x7f517000cad0 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 15 client.4698 close_dir dir 0x55fa3adf7b00 on 0x7f515c00aa80 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _ll_drop_pins 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 _ll_put 0x7f515c00b060 0x10000000002 1 -> 0 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 _ll_put 0x7f515c00aa80 0x1 2 -> 0 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 _release 0x10000000002.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _invalidate_inode_cache 0x10000000002.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _flush 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 nothing to flush 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.794 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 nothing to flush 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_caps(grant ino 0x10000000002 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.653467+0000 ctime 2024-04-25T10:35:18.656186+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f517c030900 con 0x55fa3aea4800 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 1 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 1 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 flush_caps_sync 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 trim_cache size 0 max 16384 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) n = 11 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 15 client.4698 remove_cap last one, closing snaprealm 0x7f515c00a990 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_snap_realm 0x1 0x7f515c00a990 2 -> 1 2024-04-25T10:35:18.795 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=- COMPLETE has_dir_layout 0x7f515c00aa80) 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) n = 15 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 remove_cap mds.0 on 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 15 client.4698 remove_cap last one, closing snaprealm 0x7f515c00a990 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 20 client.4698 put_snap_realm 0x1 0x7f515c00a990 1 -> 0 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 10 client.4698 _put_inode deleting 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.653467+0000 mtime=2024-04-25T10:35:18.653467+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=1 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b060) 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 2 client.4698 _close_mds_session mds.0 seq 2 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 2) -- 0x55fa3aea2a50 con 0x55fa3aea4800 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f518d909480 2 client.4698 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 mds.0 seq now 3 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 3) -- 0x7f515c00a770 con 0x55fa3aea4800 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 5 client.4698 handle_caps don't have vino 0x10000000002.head op 0, immediately releasing 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_cap_release(3) -- 0x55fa3aeb8530 con 0x55fa3aea4800 2024-04-25T10:35:18.796 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 20 client.4698 trim_cache size 0 max 16384 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.659+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x7f515c00a770 con 0x55fa3aea4800 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 10 client.4698 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 5 client.4698 _closed_mds_session mds.0 seq 3 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 1 -- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 msgr2=0x55fa3adf7170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adf7170 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 10 client.4698 remove_session_caps mds.0 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 10 client.4698 kick_requests_closed for mds.0 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 20 client.4698 trim_cache size 0 max 16384 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f5184bce640 10 client.4698 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 2 client.4698 unmounted. 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 client.4698 shutdown 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55fa3ae10aa0 tx=0x55fa3ae04f00 comp rx=0 tx=0).stop 2024-04-25T10:35:18.797 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 shutdown_connections 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adf7170 unknown :-1 s=CLOSED pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ae06650 0x55fa3adfe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7ea40 0x55fa3ae03b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 --2- 172.21.15.103:0/833121065 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 >> 172.21.15.103:0/833121065 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 shutdown_connections 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 1 -- 172.21.15.103:0/833121065 wait complete. 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.661+0000 7f518d909480 20 client.4698 trim_cache size 0 max 16384 2024-04-25T10:35:18.798 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.LlreadvLlwritevOPathFileHandle (28 ms) 2024-04-25T10:35:18.799 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.LlreadvLlwritevReadOnlyFile 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.662+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad39910 0x55fa3adfe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ea40 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c005910 con 0x55fa3ad7ea40 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad79610 con 0x55fa3ad39910 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aea6230 con 0x55fa3ae06650 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ea40 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ea40 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39410/0 (socket says 172.21.15.103:39410) 2024-04-25T10:35:18.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5186bd2640 1 -- 172.21.15.103:0/2557096823 learned_addr learned my addr 172.21.15.103:0/2557096823 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f51873d3640 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad39910 0x55fa3adfe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5186bd2640 1 -- 172.21.15.103:0/2557096823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5186bd2640 1 -- 172.21.15.103:0/2557096823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad39910 msgr2=0x55fa3adfe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad39910 0x55fa3adfe3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.663+0000 7f5186bd2640 1 -- 172.21.15.103:0/2557096823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aea53e0 con 0x55fa3ad7ea40 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ea40 0x55fa3aeb8fa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f517c0184d0 tx=0x55fa3aeb0a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640bcca6f527a1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c04e040 con 0x55fa3ad7ea40 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517c030430 con 0x55fa3ad7ea40 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 10 client.4701 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3adfeb30 con 0x55fa3ad7ea40 2024-04-25T10:35:18.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5175ffb640 20 client.4701 tick 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5175ffb640 20 client.4701 collect_and_send_metrics 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5175ffb640 20 client.4701 collect_and_send_global_metrics 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5175ffb640 5 client.4701 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5175ffb640 20 client.4701 trim_cache size 0 max 16384 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5175ffb640 20 client.4701 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3aeb8530 con 0x55fa3ad7ea40 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c044040 con 0x55fa3ad7ea40 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5185bd0640 1 client.4701 handle_mds_map epoch 6 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 20 client.4701 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 20 client.4701 mds is 0 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 10 client.4701 _open_mds_session mds.0 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aea4800 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f518d909480 10 client.4701 waiting for session to mds.0 to open 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f51873d3640 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.664+0000 7f5185bd0640 10 client.4701 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.665+0000 7f51873d3640 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3ad7b420 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174472f2c09becc3 server_cookie=dabfa8754e9e4356 in_seq=0 out_seq=0 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aea4800 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f5185bd0640 10 client.4701 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f5185bd0640 10 client.4701 renew_caps mds.0 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00aa80 con 0x55fa3aea4800 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f5185bd0640 10 client.4701 connect_mds_targets for mds.0 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f518d909480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f518d909480 20 client.4701 mds is 0 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f518d909480 10 client.4701 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f518d909480 20 client.4701 encode_cap_releases enter (req: 0x55fa3ae047e0, mds: 0) 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f518d909480 20 client.4701 send_request set sent_stamp to 2024-04-25T10:35:18.667341+0000 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f518d909480 10 client.4701 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.665069+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.665069+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf7170 con 0x55fa3aea4800 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f518d909480 20 client.4701 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00aa80 con 0x55fa3aea4800 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.666+0000 7f5185bd0640 10 client.4701 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518007c070 con 0x55fa3aea4800 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 insert_trace from 2024-04-25T10:35:18.667341+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 features 0xffffffffffffffff 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 update_snap_trace len 70 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 get_snap_realm 0x1 0x7f515c004030, nref now is 1 2024-04-25T10:35:18.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 15 client.4701 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 15 client.4701 snapc 1=[] 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 put_snap_realm 0x1 0x7f515c004030 2 -> 1 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00aca0) - ctime 2024-04-25T10:35:18.656186+0000 mtime 2024-04-25T10:35:18.656186+0000 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 dir hash is 2 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 12 client.4701 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 12 client.4701 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=- has_dir_layout 0x7f515c00aca0) caps pAsLsXsFs 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 get_snap_realm 0x1 0x7f515c004030, nref was 1 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 get_snap_realm 0x1 0x7f515c004030, nref now is 2 2024-04-25T10:35:18.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 15 client.4701 add_update_cap first one, opened snaprealm 0x7f515c004030 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00aca0) 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00aca0) 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 put_snap_realm 0x1 0x7f515c004030 2 -> 1 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 lat 0.000383 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 _ll_get 0x7f515c00aca0 0x1 -> 1 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 2 client.4701 unmount 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 1 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 1 2024-04-25T10:35:18.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 unmounting: trim pass, size was 0+1 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 20 client.4701 trim_cache size 0 max 16384 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f5185bd0640 10 client.4701 unmounting: trim pass, size still 0+1 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 2 client.4701 unmounting 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 1 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 1 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 _ll_drop_pins 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 _ll_put 0x7f515c00aca0 0x1 1 -> 0 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 1 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 1 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 nothing to flush 2024-04-25T10:35:18.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 1 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 1 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 flush_caps_sync 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 trim_cache size 0 max 16384 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) n = 8 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00aca0) 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 15 client.4701 remove_cap last one, closing snaprealm 0x7f515c004030 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 20 client.4701 put_snap_realm 0x1 0x7f515c004030 1 -> 0 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 10 client.4701 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=- COMPLETE has_dir_layout 0x7f515c00aca0) 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 2 client.4701 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3ae007c0 con 0x55fa3aea4800 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.667+0000 7f518d909480 2 client.4701 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ae007c0 con 0x55fa3aea4800 2024-04-25T10:35:18.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f5185bd0640 10 client.4701 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f5185bd0640 5 client.4701 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f5185bd0640 1 -- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 msgr2=0x55fa3ad7b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f5185bd0640 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3ad7b420 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f5185bd0640 10 client.4701 remove_session_caps mds.0 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f5185bd0640 10 client.4701 kick_requests_closed for mds.0 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 2 client.4701 unmounted. 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 client.4701 shutdown 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ea40 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ea40 0x55fa3aeb8fa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f517c0184d0 tx=0x55fa3aeb0a30 comp rx=0 tx=0).stop 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 shutdown_connections 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=CLOSED pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 0x55fa3ae03b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7ea40 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.827 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 --2- 172.21.15.103:0/2557096823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad39910 0x55fa3adfe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 >> 172.21.15.103:0/2557096823 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 shutdown_connections 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 1 -- 172.21.15.103:0/2557096823 wait complete. 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.669+0000 7f518d909480 20 client.4701 trim_cache size 0 max 16384 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.670+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.670+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ea40 0x55fa3ae03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c005260 con 0x55fa3ad39910 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad7c3f0 con 0x55fa3ad7ea40 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeb99e0 con 0x55fa3ae06650 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.828 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39424/0 (socket says 172.21.15.103:39424) 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 -- 172.21.15.103:0/2825229938 learned_addr learned my addr 172.21.15.103:0/2825229938 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ea40 0x55fa3ae03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 -- 172.21.15.103:0/2825229938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 msgr2=0x55fa3ad7b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae06650 0x55fa3ad7b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 -- 172.21.15.103:0/2825229938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ea40 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad7ea40 0x55fa3ae03b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ad7a620 con 0x55fa3ad39910 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51873d3640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5180003060 tx=0x55fa3ae0cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e91bc9809a40599 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180093040 con 0x55fa3ad39910 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f518005e650 con 0x55fa3ad39910 2024-04-25T10:35:18.829 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f518d909480 10 client.4704 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aeb2f80 con 0x55fa3ad39910 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51767fc640 20 client.4704 tick 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51767fc640 20 client.4704 collect_and_send_metrics 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51767fc640 20 client.4704 collect_and_send_global_metrics 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51767fc640 5 client.4704 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51767fc640 20 client.4704 trim_cache size 0 max 16384 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.671+0000 7f51767fc640 20 client.4704 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f518005e850 con 0x55fa3ad39910 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066040 con 0x55fa3ad39910 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f5184bce640 1 client.4704 handle_mds_map epoch 6 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f518d909480 20 client.4704 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f518d909480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f518d909480 20 client.4704 mds is 0 2024-04-25T10:35:18.830 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f518d909480 10 client.4704 _open_mds_session mds.0 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f518d909480 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adfe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aea4800 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f518d909480 10 client.4704 waiting for session to mds.0 to open 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adfe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f5184bce640 10 client.4704 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.672+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adfe3a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2578db9c2d50f8d4 server_cookie=94c0682cf4ef8822 in_seq=0 out_seq=0 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aea4800 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 renew_caps mds.0 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00aa80 con 0x55fa3aea4800 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 connect_mds_targets for mds.0 2024-04-25T10:35:18.831 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 mds is 0 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 10 client.4704 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 encode_cap_releases enter (req: 0x55fa3ad801c0, mds: 0) 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 send_request set sent_stamp to 2024-04-25T10:35:18.674778+0000 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 10 client.4704 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.672610+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.672610+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb0740 con 0x55fa3aea4800 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 awaiting reply|forward|kick on 0x7ffc16ba7a90 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00aa80 con 0x55fa3aea4800 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c036030 con 0x55fa3aea4800 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 insert_trace from 2024-04-25T10:35:18.674778+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 features 0xffffffffffffffff 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 update_snap_trace len 70 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref now is 1 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 15 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 15 client.4704 snapc 1=[] 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 put_snap_realm 0x1 0x7f515c00aca0 2 -> 1 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00ad90) - ctime 2024-04-25T10:35:18.656186+0000 mtime 2024-04-25T10:35:18.656186+0000 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 dir hash is 2 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 12 client.4704 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=- has_dir_layout 0x7f515c00ad90) caps pAsLsXsFs 2024-04-25T10:35:18.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref was 1 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref now is 2 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f515c00aca0 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 10 client.4704 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 put_snap_realm 0x1 0x7f515c00aca0 2 -> 1 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 handle_client_reply signalling caller 0x7ffc16ba7a90 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 lat 0.000378 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 _ll_get 0x7f515c00ad90 0x1 -> 1 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f5184bce640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevreadonlyfile43224 0666 576, uid 0, gid 0 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 10 client.4704 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90) dn 'test_llreadvllwritevreadonlyfile43224' 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 10 client.4704 _getattr mask As issued=1 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 3 client.4704 may_create 0x7f515c00ad90 = 0 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 8 client.4704 _create(0x1 test_llreadvllwritevreadonlyfile43224, 0666) 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90) name test_llreadvllwritevreadonlyfile43224 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 15 open_dir 0x55fa3aeb3060 on 0x7f515c00ad90 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 15 client.4704 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90) 'test_llreadvllwritevreadonlyfile43224' dn 0x1.head["test_llreadvllwritevreadonlyfile43224"] (new dn) 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 choose_target_mds inode dir hash is 2 on test_llreadvllwritevreadonlyfile43224 => 3521655403 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90) is_hash=1 hash=3521655403 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 10 client.4704 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 mds is 0 2024-04-25T10:35:18.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 10 client.4704 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 encode_cap_releases enter (req: 0x55fa3aeb0740, mds: 0) 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 encode_dentry_release enter(dn:0x7f515c00a990) 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00ad90), req:0x55fa3aeb0740 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 send_request set sent_stamp to 2024-04-25T10:35:18.675232+0000 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 10 client.4704 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile43224 2024-04-25T10:35:18.675214+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile43224 2024-04-25T10:35:18.675214+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb7c40 con 0x55fa3aea4800 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.674+0000 7f518d909480 20 client.4704 awaiting reply|forward|kick on 0x7ffc16ba78e0 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 858+0+0 (crc 0 0 0) 0x7f517c018a30 con 0x55fa3aea4800 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 insert_trace from 2024-04-25T10:35:18.675232+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 features 0xffffffffffffffff 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 update_snap_trace len 70 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref was 1 2024-04-25T10:35:18.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref now is 2 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 hrm is_target=1 is_dentry=1 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) - ctime 2024-04-25T10:35:18.675214+0000 mtime 2024-04-25T10:35:18.675214+0000 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 12 client.4704 add_update_inode adding 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) caps pAsxLsXsxFscr 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref was 2 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref now is 3 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f515c00aca0 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 add_update_cap issued - -> pAsxLsXsxFscr from mds.0 on 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 12 client.4704 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) caps pAsLsXs 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.656186+0000 ctime=2024-04-25T10:35:18.656186+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) pAsLsXs ctime 2024-04-25T10:35:18.675214+0000 mtime 2024-04-25T10:35:18.675214+0000 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 dir hash is 2 2024-04-25T10:35:18.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 12 client.4704 add_update_inode client inode change_attr: 6 , mds inodestat change_attr: 7 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 12 client.4704 insert_dentry_inode 'test_llreadvllwritevreadonlyfile43224' vino 0x10000000003.head in dir 0x1.head dn 0x7f515c00a990 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 15 client.4704 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 'test_llreadvllwritevreadonlyfile43224' to inode 0x7f515c00b370 dn 0x1.head["test_llreadvllwritevreadonlyfile43224"] (old dn) 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 link inode 0x7f515c00b370 parents now 0x1.head["test_llreadvllwritevreadonlyfile43224"] 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 15 client.4704 update_dentry_lease 0x1.head["test_llreadvllwritevreadonlyfile43224"] lease(mask 7 dur 30000) from 2024-04-25T10:35:18.675232+0000 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 got dentry lease on test_llreadvllwritevreadonlyfile43224 dur 30000ms ttl 2024-04-25T10:35:48.675232+0000 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 put_snap_realm 0x1 0x7f515c00aca0 3 -> 2 2024-04-25T10:35:18.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 handle_client_reply signalling caller 0x7ffc16ba78e0 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 20 client.4704 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 10 client.4704 delegated_inos: [] 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 10 client.4704 make_request created ino 0x10000000003 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 20 client.4704 make_request target is 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 20 client.4704 lat 0.002371 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 10 client.4704 _create_fh 0x10000000003 mode 1 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 20 client.4704 trim_cache size 1 max 16384 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 8 client.4704 create(#0x1/test_llreadvllwritevreadonlyfile43224, 0100666 layout 0 0 0) = 0 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 20 client.4704 _ll_create created = 1 2024-04-25T10:35:18.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevreadonlyfile43224 0666 576 = 0 (0x55fa3ad7efb0 10000000003) 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 20 client.4704 _ll_get 0x7f515c00b370 0x10000000003 -> 1 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 10 client.4704 fill_statx on 0x10000000003 snap/devhead mode 0100666 mtime 2024-04-25T10:35:18.675214+0000 ctime 2024-04-25T10:35:18.675214+0000 change_attr 0 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 3 client.4704 pwritev(0x55fa3ad7efb0, "...", 14, 0) = -9 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aeb8000 0x55fa3adf4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- osd_op(unknown.0.0:1 3.32 3:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x55fa3aea4130 con 0x55fa3aeb8000 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- osd_op(unknown.0.0:2 3.32 3:4def72d4:::10000000003.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x55fa3aeb1d60 con 0x55fa3aeb8000 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aeb8000 0x55fa3adf4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5184bce640 10 client.4704 ms_handle_connect on v2:172.21.15.103:6808/1654732884 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aeb8000 0x55fa3adf4430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=edabf5b43273e7f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.677+0000 7f5187bd4640 1 -- 172.21.15.103:0/2825229938 <== osd.0 v2:172.21.15.103:6808/1654732884 1 ==== osd_op_reply(1 10000000003.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3aeb8000 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5187bd4640 1 -- 172.21.15.103:0/2825229938 <== osd.0 v2:172.21.15.103:6808/1654732884 2 ==== osd_op_reply(2 10000000003.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3aeb8000 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 get_caps 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) have pAsxLsXsxFscr need Fr want Fc revoking - 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 _read_async 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=1} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 0~14 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 3 client.4704 preadv(0x55fa3ad7efb0, 0) = 0 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 3 client.4704 ll_release (fh)0x55fa3ad7efb0 0x10000000003 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 8 client.4704 _release_fh 0x55fa3ad7efb0 mode 1 on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=0} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 _flush 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 nothing to flush 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 check_caps on 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) wanted - used - issued pAsxLsXsxFscr revoking - flags=0 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 cap mds.0 issued pAsxLsXsxFscr implemented pAsxLsXsxFscr revoking - 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 delaying cap release 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 cap_delay_requeue on 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 _release_fh 0x55fa3ad7efb0 on inode 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) no async_err state 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 3 client.4704 ll_unlink 0x1.head test_llreadvllwritevreadonlyfile43224 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90); ; name test_llreadvllwritevreadonlyfile43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 _getattr mask As issued=1 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 3 client.4704 may_delete 0x7f515c00ad90 = 0 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 8 client.4704 _unlink(0x1 test_llreadvllwritevreadonlyfile43224 uid 0 gid 0) 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) name test_llreadvllwritevreadonlyfile43224 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 _lookup have 0x1.head["test_llreadvllwritevreadonlyfile43224"] from mds.0 ttl 2024-04-25T10:35:48.675232+0000 seq 2 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) test_llreadvllwritevreadonlyfile43224 = 0x10000000003.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) 2024-04-25T10:35:18.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 choose_target_mds inode dir hash is 2 on test_llreadvllwritevreadonlyfile43224 => 3521655403 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) is_hash=1 hash=3521655403 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 choose_target_mds from dirfragtree hash 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 mds is 0 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 encode_cap_releases enter (req: 0x55fa3aeb1d60, mds: 0) 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 encode_inode_release enter(in:0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370), req:0x55fa3aeb1d60 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 encode_dentry_release enter(dn:0x7f515c00a990) 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90), req:0x55fa3aeb1d60 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 send_request set sent_stamp to 2024-04-25T10:35:18.679826+0000 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 10 client.4704 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevreadonlyfile43224 2024-04-25T10:35:18.679785+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevreadonlyfile43224 2024-04-25T10:35:18.679785+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf4970 con 0x55fa3aea4800 2024-04-25T10:35:18.843 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f518d909480 20 client.4704 awaiting reply|forward|kick on 0x7ffc16ba7ab0 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_caps(revoke ino 0x10000000003 1 seq 2 caps=pAsXsFscr dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.675214+0000 ctime 2024-04-25T10:35:18.675214+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c064020 con 0x55fa3aea4800 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 5 client.4704 set_cap_epoch_barrier epoch = 20 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 10 client.4704 mds.0 seq now 1 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 5 client.4704 handle_cap_grant on in 0x10000000003 mds.0 seq 2 caps now pAsXsFscr was pAsxXsxFscr 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 10 client.4704 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsxXsxFscr(0=pAsxXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) pAsxXsxFscr ctime 2024-04-25T10:35:18.675214+0000 mtime 2024-04-25T10:35:18.675214+0000 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 10 client.4704 revocation of AxXx 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 10 client.4704 check_caps on 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) wanted - used - issued pAsXsFscr revoking AxXx flags=1 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 10 client.4704 cap mds.0 issued pAsXsFscr implemented pAsxXsxFscr revoking AxXx 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 10 client.4704 completed revocation of AxXx 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 10 client.4704 send_cap 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile43224"] 0x7f515c00b370) mds.0 seq 2 used - want - flush - retain pAsLsXsFscr held pAsxXsxFscr revoking AxXx dropping - 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 15 client.4704 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000003 1 seq 2 caps=pAsXsFscr dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.675214+0000 ctime 2024-04-25T10:35:18.675214+0000 change_attr 0) -- 0x7f515c00b950 con 0x55fa3aea4800 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.679+0000 7f5184bce640 10 client.4704 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 506+0+0 (crc 0 0 0) 0x7f517c000bc0 con 0x55fa3aea4800 2024-04-25T10:35:18.844 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 handle_client_reply got a reply. Safe:0 tid 3 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 10 client.4704 insert_trace from 2024-04-25T10:35:18.679826+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 10 client.4704 features 0xffffffffffffffff 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 10 client.4704 update_snap_trace len 70 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref was 2 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 get_snap_realm 0x1 0x7f515c00aca0, nref now is 3 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 10 client.4704 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 10 client.4704 hrm is_target=0 is_dentry=1 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 12 client.4704 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) caps pAsLsXs 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) pAsLsXs ctime 2024-04-25T10:35:18.679785+0000 mtime 2024-04-25T10:35:18.675214+0000 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 dir hash is 2 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 12 client.4704 add_update_inode client inode change_attr: 7 , mds inodestat change_attr: 8 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 10 client.4704 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.845 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 15 client.4704 unlink dir 0x7f515c00ad90 'test_llreadvllwritevreadonlyfile43224' dn 0x7f515c00a990 inode 0x7f515c00b370 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 unlink inode 0x7f515c00b370 parents now 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 15 client.4704 update_dentry_lease 0x1.head["test_llreadvllwritevreadonlyfile43224"] lease(mask 3 dur 30000) from 2024-04-25T10:35:18.679826+0000 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 10 client.4704 got dentry lease on test_llreadvllwritevreadonlyfile43224 dur 30000ms ttl 2024-04-25T10:35:48.679826+0000 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 put_snap_realm 0x1 0x7f515c00aca0 3 -> 2 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 handle_client_reply signalling caller 0x7ffc16ba7ab0 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f5184bce640 20 client.4704 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 20 client.4704 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 20 client.4704 lat 0.001029 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 20 client.4704 trim_cache size 1 max 16384 2024-04-25T10:35:18.846 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 8 client.4704 unlink(#0x1/test_llreadvllwritevreadonlyfile43224) = 0 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 2 client.4704 unmount 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 2 client.4704 unmounting 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3aea51c0 con 0x55fa3aea4800 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.680+0000 7f518d909480 10 client.4704 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_caps(grant ino 0x10000000003 1 seq 3 caps=pAsLsXsFscr dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.675214+0000 ctime 2024-04-25T10:35:18.679785+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f515c00b950 con 0x55fa3aea4800 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 mds.0 seq now 2 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 5 client.4704 handle_cap_grant on in 0x10000000003 mds.0 seq 3 caps now pAsLsXsFscr was pAsXsFscr 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.675214+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) pAsXsFscr ctime 2024-04-25T10:35:18.679785+0000 mtime 2024-04-25T10:35:18.675214+0000 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 grant, new caps are Ls 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 5 client.4704 _try_to_trim_inode in 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 20 client.4704 trim_cache size 1 max 16384 2024-04-25T10:35:18.847 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 unmounting: trim pass, size still 1+2 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f517c00bcb0 con 0x55fa3aea4800 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 insert_trace from 2024-04-25T10:35:18.679826+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 20 client.4704 trim_cache size 1 max 16384 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 15 client.4704 trim_dentry unlinking dn test_llreadvllwritevreadonlyfile43224 in dir 0x1 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 15 client.4704 unlink dir 0x7f515c00ad90 'test_llreadvllwritevreadonlyfile43224' dn 0x7f515c00a990 inode 0 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 15 client.4704 unlink removing 'test_llreadvllwritevreadonlyfile43224' dn 0x7f515c00a990 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 15 client.4704 close_dir dir 0x55fa3aeb3060 on 0x7f515c00ad90 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.848 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f5184bce640 10 client.4704 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _ll_drop_pins 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 _ll_put 0x7f515c00b370 0x10000000003 1 -> 0 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 _ll_put 0x7f515c00ad90 0x1 2 -> 0 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 _release 0x10000000003.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _invalidate_inode_cache 0x10000000003.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _flush 0x10000000003.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 nothing to flush 2024-04-25T10:35:18.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 nothing to flush 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x10000000003.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 1 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 1 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 flush_caps_sync 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 trim_cache size 0 max 16384 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) n = 11 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 15 client.4704 remove_cap last one, closing snaprealm 0x7f515c00aca0 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_snap_realm 0x1 0x7f515c00aca0 2 -> 1 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=- COMPLETE has_dir_layout 0x7f515c00ad90) 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _put_inode on 0x10000000003.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) n = 15 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 remove_cap mds.0 on 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 15 client.4704 remove_cap last one, closing snaprealm 0x7f515c00aca0 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 20 client.4704 put_snap_realm 0x1 0x7f515c00aca0 1 -> 0 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 10 client.4704 _put_inode deleting 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.675214+0000 mtime=2024-04-25T10:35:18.675214+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=1 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b370) 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 2 client.4704 _close_mds_session mds.0 seq 2 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.682+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 2) -- 0x55fa3adff540 con 0x55fa3aea4800 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.683+0000 7f518d909480 2 client.4704 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adff540 con 0x55fa3aea4800 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 10 client.4704 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 5 client.4704 _closed_mds_session mds.0 seq 2 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 1 -- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 msgr2=0x55fa3adfe3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea4800 0x55fa3adfe3a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 10 client.4704 remove_session_caps mds.0 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 10 client.4704 kick_requests_closed for mds.0 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 10 client.4704 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 20 client.4704 trim_cache size 0 max 16384 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5184bce640 10 client.4704 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 2 client.4704 unmounted. 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 client.4704 shutdown 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aeb8000 msgr2=0x55fa3adf4430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aeb8000 0x55fa3adf4430 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 --2- 172.21.15.103:0/2825229938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad39910 0x55fa3aeb8fa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5180003060 tx=0x55fa3ae0cd60 comp rx=0 tx=0).stop 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f5187bd4640 1 -- 172.21.15.103:0/2825229938 reap_dead start 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 shutdown_connections 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 >> 172.21.15.103:0/2825229938 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 shutdown_connections 2024-04-25T10:35:18.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 1 -- 172.21.15.103:0/2825229938 wait complete. 2024-04-25T10:35:18.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.684+0000 7f518d909480 20 client.4704 trim_cache size 0 max 16384 2024-04-25T10:35:18.853 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.LlreadvLlwritevReadOnlyFile (23 ms) 2024-04-25T10:35:18.853 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.LlreadvLlwritevIOClientNotMounted 2024-04-25T10:35:18.871 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.685+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.871 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aeb7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c0052f0 con 0x55fa3aea4800 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae02de0 con 0x55fa3aeb1180 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ae047e0 con 0x55fa3ad801c0 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aeb7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aeb7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39430/0 (socket says 172.21.15.103:39430) 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f5187bd4640 1 -- 172.21.15.103:0/2766617136 learned_addr learned my addr 172.21.15.103:0/2766617136 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.686+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f51873d3640 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5187bd4640 1 -- 172.21.15.103:0/2766617136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 msgr2=0x55fa3ad7b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.872 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5187bd4640 1 -- 172.21.15.103:0/2766617136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5187bd4640 1 -- 172.21.15.103:0/2766617136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3adf74c0 con 0x55fa3aea4800 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aeb7fd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5178000f80 tx=0x7f517800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfb47f1c0771624 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178005af0 con 0x55fa3aea4800 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517802a040 con 0x55fa3aea4800 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 10 client.4707 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3adfe960 con 0x55fa3aea4800 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5175ffb640 20 client.4707 tick 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5175ffb640 20 client.4707 collect_and_send_metrics 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5175ffb640 20 client.4707 collect_and_send_global_metrics 2024-04-25T10:35:18.873 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5175ffb640 5 client.4707 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5175ffb640 20 client.4707 trim_cache size 0 max 16384 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5175ffb640 20 client.4707 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5180050050 con 0x55fa3aea4800 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178037040 con 0x55fa3aea4800 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f5185bd0640 1 client.4707 handle_mds_map epoch 6 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 20 client.4707 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 10 client.4707 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 20 client.4707 mds is 0 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 10 client.4707 _open_mds_session mds.0 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ae0c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aea3cc0 2024-04-25T10:35:18.874 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f518d909480 10 client.4707 waiting for session to mds.0 to open 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.687+0000 7f51873d3640 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ae0c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.688+0000 7f5185bd0640 10 client.4707 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.688+0000 7f51873d3640 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ae0c6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d49b503aeef6cca0 server_cookie=782a2931cf4641f5 in_seq=0 out_seq=0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aea3cc0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 renew_caps mds.0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00ad90 con 0x55fa3aea3cc0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 connect_mds_targets for mds.0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 mds is 0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 encode_cap_releases enter (req: 0x55fa3aea2220, mds: 0) 2024-04-25T10:35:18.875 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 send_request set sent_stamp to 2024-04-25T10:35:18.690755+0000 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.688268+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.688268+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae0cbf0 con 0x55fa3aea3cc0 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00ad90 con 0x55fa3aea3cc0 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518000b7b0 con 0x55fa3aea3cc0 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 insert_trace from 2024-04-25T10:35:18.690755+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 features 0xffffffffffffffff 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 update_snap_trace len 70 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 get_snap_realm 0x1 0x7f515c00afb0, nref now is 1 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 15 client.4707 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 15 client.4707 snapc 1=[] 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 put_snap_realm 0x1 0x7f515c00afb0 2 -> 1 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b0a0) - ctime 2024-04-25T10:35:18.679785+0000 mtime 2024-04-25T10:35:18.679785+0000 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 dir hash is 2 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 12 client.4707 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 8 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 12 client.4707 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=- has_dir_layout 0x7f515c00b0a0) caps pAsLsXsFs 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 get_snap_realm 0x1 0x7f515c00afb0, nref was 1 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 get_snap_realm 0x1 0x7f515c00afb0, nref now is 2 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 15 client.4707 add_update_cap first one, opened snaprealm 0x7f515c00afb0 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 put_snap_realm 0x1 0x7f515c00afb0 2 -> 1 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 lat 0.000374 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 _ll_get 0x7f515c00b0a0 0x1 -> 1 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 2 client.4707 unmount 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 unmounting: trim pass, size was 0+1 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 20 client.4707 trim_cache size 0 max 16384 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f5185bd0640 10 client.4707 unmounting: trim pass, size still 0+1 2024-04-25T10:35:18.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 2 client.4707 unmounting 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 _ll_drop_pins 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 _ll_put 0x7f515c00b0a0 0x1 1 -> 0 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 nothing to flush 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 flush_caps_sync 2024-04-25T10:35:18.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 trim_cache size 0 max 16384 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) n = 8 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 15 client.4707 remove_cap last one, closing snaprealm 0x7f515c00afb0 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 20 client.4707 put_snap_realm 0x1 0x7f515c00afb0 1 -> 0 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 10 client.4707 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=- COMPLETE has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 2 client.4707 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3ae007c0 con 0x55fa3aea3cc0 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.690+0000 7f518d909480 2 client.4707 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ae007c0 con 0x55fa3aea3cc0 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 10 client.4707 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 5 client.4707 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 1 -- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 msgr2=0x55fa3ae0c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ae0c6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 10 client.4707 remove_session_caps mds.0 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 10 client.4707 kick_requests_closed for mds.0 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 10 client.4707 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 20 client.4707 trim_cache size 0 max 16384 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f5185bd0640 10 client.4707 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f518d909480 2 client.4707 unmounted. 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.692+0000 7f518d909480 1 client.4707 shutdown 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 msgr2=0x55fa3aeb7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aeb7fd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5178000f80 tx=0x7f517800f000 comp rx=0 tx=0).stop 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 shutdown_connections 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ae0c6b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aeb7fd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 --2- 172.21.15.103:0/2766617136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 >> 172.21.15.103:0/2766617136 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 shutdown_connections 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 -- 172.21.15.103:0/2766617136 wait complete. 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 20 client.4707 trim_cache size 0 max 16384 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.693+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.694+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.694+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.694+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.694+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aea20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.694+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c008f50 con 0x55fa3aea4800 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.694+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae03e60 con 0x55fa3ad801c0 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.694+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3adfe570 con 0x55fa3aea3cc0 2024-04-25T10:35:18.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aea20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aea20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39444/0 (socket says 172.21.15.103:39444) 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 -- 172.21.15.103:0/421369122 learned_addr learned my addr 172.21.15.103:0/421369122 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f51873d3640 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5186bd2640 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 -- 172.21.15.103:0/421369122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 -- 172.21.15.103:0/421369122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3ad7b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 -- 172.21.15.103:0/421369122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aeab810 con 0x55fa3aea4800 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5187bd4640 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aea20d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f517800a4f0 tx=0x7f5178003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfd69e22472a30f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178005af0 con 0x55fa3aea4800 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 10 client.4710 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517800e040 con 0x55fa3aea4800 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3adfe3a0 con 0x55fa3aea4800 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f51767fc640 20 client.4710 tick 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f51767fc640 20 client.4710 collect_and_send_metrics 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f51767fc640 20 client.4710 collect_and_send_global_metrics 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f51767fc640 5 client.4710 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f51767fc640 20 client.4710 trim_cache size 0 max 16384 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f51767fc640 20 client.4710 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178005690 con 0x55fa3aea4800 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178005e20 con 0x55fa3aea4800 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f5184bce640 1 client.4710 handle_mds_map epoch 6 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 20 client.4710 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 10 client.4710 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 20 client.4710 mds is 0 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 10 client.4710 _open_mds_session mds.0 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ae0c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.695+0000 7f518d909480 10 client.4710 waiting for session to mds.0 to open 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.696+0000 7f51873d3640 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ae0c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.696+0000 7f5184bce640 10 client.4710 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.696+0000 7f51873d3640 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ae0c6b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bba8e399ab53946 server_cookie=fdef066fb76702fc in_seq=0 out_seq=0 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 renew_caps mds.0 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00ad90 con 0x55fa3aeb0740 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 connect_mds_targets for mds.0 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 10 client.4710 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 mds is 0 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 10 client.4710 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 encode_cap_releases enter (req: 0x55fa3aeb7f50, mds: 0) 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 send_request set sent_stamp to 2024-04-25T10:35:18.698698+0000 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 10 client.4710 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.696456+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.696456+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae0cbf0 con 0x55fa3aeb0740 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 awaiting reply|forward|kick on 0x7ffc16ba7a90 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00ad90 con 0x55fa3aeb0740 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518000b7b0 con 0x55fa3aeb0740 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 insert_trace from 2024-04-25T10:35:18.698698+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 features 0xffffffffffffffff 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 update_snap_trace len 70 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 get_snap_realm 0x1 0x7f515c007d40, nref now is 1 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 15 client.4710 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 15 client.4710 snapc 1=[] 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 put_snap_realm 0x1 0x7f515c007d40 2 -> 1 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00afb0) - ctime 2024-04-25T10:35:18.679785+0000 mtime 2024-04-25T10:35:18.679785+0000 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 dir hash is 2 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 12 client.4710 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 8 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 12 client.4710 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=- has_dir_layout 0x7f515c00afb0) caps pAsLsXsFs 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 get_snap_realm 0x1 0x7f515c007d40, nref was 1 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 get_snap_realm 0x1 0x7f515c007d40, nref now is 2 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 15 client.4710 add_update_cap first one, opened snaprealm 0x7f515c007d40 2024-04-25T10:35:18.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 10 client.4710 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 put_snap_realm 0x1 0x7f515c007d40 2 -> 1 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 handle_client_reply signalling caller 0x7ffc16ba7a90 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 lat 0.000394 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 _ll_get 0x7f515c00afb0 0x1 -> 1 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f5184bce640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 8 client.4710 _ll_create 0x1.head test_llreadvllwritevioclientnotmountedfile43224 0666 578, uid 0, gid 0 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 10 client.4710 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0) dn 'test_llreadvllwritevioclientnotmountedfile43224' 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 10 client.4710 _getattr mask As issued=1 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 3 client.4710 may_create 0x7f515c00afb0 = 0 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 8 client.4710 _create(0x1 test_llreadvllwritevioclientnotmountedfile43224, 0666) 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0) name test_llreadvllwritevioclientnotmountedfile43224 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 15 open_dir 0x55fa3aea4350 on 0x7f515c00afb0 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 15 client.4710 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0) 'test_llreadvllwritevioclientnotmountedfile43224' dn 0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] (new dn) 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 choose_target_mds inode dir hash is 2 on test_llreadvllwritevioclientnotmountedfile43224 => 3543335341 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0) is_hash=1 hash=3543335341 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 10 client.4710 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 mds is 0 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 10 client.4710 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 encode_cap_releases enter (req: 0x55fa3ae0cbf0, mds: 0) 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 encode_dentry_release enter(dn:0x7f515c00aca0) 2024-04-25T10:35:18.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f515c00afb0), req:0x55fa3ae0cbf0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 send_request set sent_stamp to 2024-04-25T10:35:18.699170+0000 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 10 client.4710 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevioclientnotmountedfile43224 2024-04-25T10:35:18.699151+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevioclientnotmountedfile43224 2024-04-25T10:35:18.699151+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9eb90 con 0x55fa3aeb0740 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.698+0000 7f518d909480 20 client.4710 awaiting reply|forward|kick on 0x7ffc16ba78e0 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 868+0+0 (crc 0 0 0) 0x7f518001a130 con 0x55fa3aeb0740 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 insert_trace from 2024-04-25T10:35:18.699170+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 features 0xffffffffffffffff 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 update_snap_trace len 70 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 get_snap_realm 0x1 0x7f515c007d40, nref was 1 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 get_snap_realm 0x1 0x7f515c007d40, nref now is 2 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 hrm is_target=1 is_dentry=1 2024-04-25T10:35:18.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 update_inode_file_time 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) - ctime 2024-04-25T10:35:18.699151+0000 mtime 2024-04-25T10:35:18.699151+0000 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 12 client.4710 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 12 client.4710 add_update_inode adding 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=- objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 get_snap_realm 0x1 0x7f515c007d40, nref was 2 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 get_snap_realm 0x1 0x7f515c007d40, nref now is 3 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 15 client.4710 add_update_cap first one, opened snaprealm 0x7f515c007d40 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 12 client.4710 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) caps pAsLsXs 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.679785+0000 ctime=2024-04-25T10:35:18.679785+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) pAsLsXs ctime 2024-04-25T10:35:18.699151+0000 mtime 2024-04-25T10:35:18.699151+0000 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 dir hash is 2 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 12 client.4710 add_update_inode client inode change_attr: 8 , mds inodestat change_attr: 9 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 12 client.4710 insert_dentry_inode 'test_llreadvllwritevioclientnotmountedfile43224' vino 0x10000000004.head in dir 0x1.head dn 0x7f515c00aca0 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 clearing I_DIR_ORDERED on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 15 client.4710 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) 'test_llreadvllwritevioclientnotmountedfile43224' to inode 0x7f515c00b590 dn 0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] (old dn) 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 link inode 0x7f515c00b590 parents now 0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 15 client.4710 update_dentry_lease 0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] lease(mask 7 dur 30000) from 2024-04-25T10:35:18.699170+0000 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 10 client.4710 got dentry lease on test_llreadvllwritevioclientnotmountedfile43224 dur 30000ms ttl 2024-04-25T10:35:48.699170+0000 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 put_snap_realm 0x1 0x7f515c007d40 3 -> 2 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 handle_client_reply signalling caller 0x7ffc16ba78e0 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 delegated_inos: [] 2024-04-25T10:35:18.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 make_request created ino 0x10000000004 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 make_request target is 0x10000000004.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 lat 0.002548 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000004.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000004.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _create_fh 0x10000000004 mode 3 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 trim_cache size 1 max 16384 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 8 client.4710 create(#0x1/test_llreadvllwritevioclientnotmountedfile43224, 0100666 layout 0 0 0) = 0 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 _ll_create created = 1 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 8 client.4710 _ll_create 0x1.head test_llreadvllwritevioclientnotmountedfile43224 0666 578 = 0 (0x55fa3ad7efb0 10000000004) 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 _ll_get 0x7f515c00b590 0x10000000004 -> 1 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 fill_statx on 0x10000000004 snap/devhead mode 0100666 mtime 2024-04-25T10:35:18.699151+0000 ctime 2024-04-25T10:35:18.699151+0000 change_attr 0 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 3 client.4710 ll_release (fh)0x55fa3ad7efb0 0x10000000004 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f5184bce640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 8 client.4710 _release_fh 0x55fa3ad7efb0 mode 3 on 0x10000000004.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _flush 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 nothing to flush 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 check_caps on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 delaying cap release 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 cap_delay_requeue on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _release_fh 0x55fa3ad7efb0 on inode 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) no async_err state 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 2 client.4710 unmount 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 2 client.4710 unmounting 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _ll_drop_pins 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 _ll_put 0x7f515c00b590 0x10000000004 1 -> 0 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 _ll_put 0x7f515c00afb0 0x1 2 -> 0 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 _release 0x10000000004.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _invalidate_inode_cache 0x10000000004.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _flush 0x10000000004.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 nothing to flush 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 _release 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _flush 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 nothing to flush 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 flush_caps_sync 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 trim_cache size 1 max 16384 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 15 client.4710 trim_dentry unlinking dn test_llreadvllwritevioclientnotmountedfile43224 in dir 0x1 2024-04-25T10:35:18.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 clearing (I_COMPLETE|I_DIR_ORDERED) on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 15 client.4710 unlink dir 0x7f515c00afb0 'test_llreadvllwritevioclientnotmountedfile43224' dn 0x7f515c00aca0 inode 0x7f515c00b590 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 unlink inode 0x7f515c00b590 parents now 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 15 client.4710 unlink removing 'test_llreadvllwritevioclientnotmountedfile43224' dn 0x7f515c00aca0 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 15 client.4710 close_dir dir 0x55fa3aea4350 on 0x7f515c00afb0 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_inode on 0x10000000004.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 10 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 15 client.4710 remove_cap last one, closing snaprealm 0x7f515c007d40 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_snap_realm 0x1 0x7f515c007d40 2 -> 1 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=- has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _put_inode on 0x10000000004.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 13 2024-04-25T10:35:18.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 remove_cap mds.0 on 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 15 client.4710 remove_cap last one, closing snaprealm 0x7f515c007d40 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 20 client.4710 put_snap_realm 0x1 0x7f515c007d40 1 -> 0 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 10 client.4710 _put_inode deleting 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.699151+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=0 caps=- objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 2 client.4710 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3aeb3050 con 0x55fa3aeb0740 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.701+0000 7f518d909480 2 client.4710 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aeb3050 con 0x55fa3aeb0740 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 10 client.4710 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 5 client.4710 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 1 -- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 msgr2=0x55fa3ae0c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ae0c6b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 10 client.4710 remove_session_caps mds.0 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 10 client.4710 kick_requests_closed for mds.0 2024-04-25T10:35:18.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 10 client.4710 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 20 client.4710 trim_cache size 0 max 16384 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f5184bce640 10 client.4710 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 2 client.4710 unmounted. 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 client.4710 shutdown 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 msgr2=0x55fa3aea20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aea20d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f517800a4f0 tx=0x7f5178003330 comp rx=0 tx=0).stop 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 shutdown_connections 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ae0c6b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3aea20d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 --2- 172.21.15.103:0/421369122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 >> 172.21.15.103:0/421369122 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.703+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 shutdown_connections 2024-04-25T10:35:18.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.704+0000 7f518d909480 1 -- 172.21.15.103:0/421369122 wait complete. 2024-04-25T10:35:18.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.704+0000 7f518d909480 20 client.4710 trim_cache size 0 max 16384 2024-04-25T10:35:18.900 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.LlreadvLlwritevIOClientNotMounted (19 ms) 2024-04-25T10:35:18.900 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.LlreadvLlwritevNegativeIOVCount 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.704+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c008db0 con 0x55fa3ad801c0 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad82980 con 0x55fa3aea4800 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad82b80 con 0x55fa3aea3cc0 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.919 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39456/0 (socket says 172.21.15.103:39456) 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f51873d3640 1 -- 172.21.15.103:0/1986491732 learned_addr learned my addr 172.21.15.103:0/1986491732 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.705+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f51873d3640 1 -- 172.21.15.103:0/1986491732 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3ad7b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f51873d3640 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3ad7b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f51873d3640 1 -- 172.21.15.103:0/1986491732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f51873d3640 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f51873d3640 1 -- 172.21.15.103:0/1986491732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae00770 con 0x55fa3ad801c0 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f51873d3640 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb7d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51800a2040 tx=0x55fa3ae03090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcf1546e1c2dd12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180093040 con 0x55fa3ad801c0 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f518005e570 con 0x55fa3ad801c0 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 10 client.4713 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.920 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae057b0 con 0x55fa3ad801c0 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5175ffb640 20 client.4713 tick 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5175ffb640 20 client.4713 collect_and_send_metrics 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5175ffb640 20 client.4713 collect_and_send_global_metrics 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5175ffb640 5 client.4713 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5175ffb640 20 client.4713 trim_cache size 0 max 16384 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5175ffb640 20 client.4713 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5180045a30 con 0x55fa3ad801c0 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066040 con 0x55fa3ad801c0 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5185bd0640 1 client.4713 handle_mds_map epoch 6 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 20 client.4713 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 10 client.4713 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 20 client.4713 mds is 0 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 10 client.4713 _open_mds_session mds.0 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.921 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f518d909480 10 client.4713 waiting for session to mds.0 to open 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.706+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.707+0000 7f5185bd0640 10 client.4713 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.707+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7d3a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e345fa368147f284 server_cookie=45d193136cd8cc5a in_seq=0 out_seq=0 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f5185bd0640 10 client.4713 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f5185bd0640 10 client.4713 renew_caps mds.0 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00ad90 con 0x55fa3aeb0740 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f5185bd0640 10 client.4713 connect_mds_targets for mds.0 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f518d909480 10 client.4713 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f518d909480 20 client.4713 mds is 0 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f518d909480 10 client.4713 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.922 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f518d909480 20 client.4713 encode_cap_releases enter (req: 0x55fa3ae0c830, mds: 0) 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f518d909480 20 client.4713 send_request set sent_stamp to 2024-04-25T10:35:18.710256+0000 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f518d909480 10 client.4713 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.707245+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.707245+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad7d9e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f518d909480 20 client.4713 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00ad90 con 0x55fa3aeb0740 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.709+0000 7f5185bd0640 10 client.4713 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c036040 con 0x55fa3aeb0740 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 insert_trace from 2024-04-25T10:35:18.710256+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 features 0xffffffffffffffff 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 update_snap_trace len 70 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 get_snap_realm 0x1 0x7f515c00afb0, nref now is 1 2024-04-25T10:35:18.923 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 15 client.4713 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 15 client.4713 snapc 1=[] 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 put_snap_realm 0x1 0x7f515c00afb0 2 -> 1 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b0a0) - ctime 2024-04-25T10:35:18.699151+0000 mtime 2024-04-25T10:35:18.699151+0000 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 dir hash is 2 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 12 client.4713 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 9 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 12 client.4713 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=- has_dir_layout 0x7f515c00b0a0) caps pAsLsXsFs 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 get_snap_realm 0x1 0x7f515c00afb0, nref was 1 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 get_snap_realm 0x1 0x7f515c00afb0, nref now is 2 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 15 client.4713 add_update_cap first one, opened snaprealm 0x7f515c00afb0 2024-04-25T10:35:18.924 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 put_snap_realm 0x1 0x7f515c00afb0 2 -> 1 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 lat 0.000409 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 _ll_get 0x7f515c00b0a0 0x1 -> 1 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 2 client.4713 unmount 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 unmounting: trim pass, size was 0+1 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 20 client.4713 trim_cache size 0 max 16384 2024-04-25T10:35:18.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f5185bd0640 10 client.4713 unmounting: trim pass, size still 0+1 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 2 client.4713 unmounting 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 _ll_drop_pins 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 _ll_put 0x7f515c00b0a0 0x1 1 -> 0 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 nothing to flush 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 1 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 flush_caps_sync 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 trim_cache size 0 max 16384 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) n = 8 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 15 client.4713 remove_cap last one, closing snaprealm 0x7f515c00afb0 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 20 client.4713 put_snap_realm 0x1 0x7f515c00afb0 1 -> 0 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 10 client.4713 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=- has_dir_layout 0x7f515c00b0a0) 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 2 client.4713 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3ae06260 con 0x55fa3aeb0740 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.710+0000 7f518d909480 2 client.4713 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ae06260 con 0x55fa3aeb0740 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 10 client.4713 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 5 client.4713 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 1 -- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 msgr2=0x55fa3ad7d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7d3a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 10 client.4713 remove_session_caps mds.0 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 10 client.4713 kick_requests_closed for mds.0 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 10 client.4713 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 20 client.4713 trim_cache size 0 max 16384 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f5185bd0640 10 client.4713 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 2 client.4713 unmounted. 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 client.4713 shutdown 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb7d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f51800a2040 tx=0x55fa3ae03090 comp rx=0 tx=0).stop 2024-04-25T10:35:18.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 shutdown_connections 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7d3a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea4800 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3ad7b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 --2- 172.21.15.103:0/1986491732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb7d40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.711+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 >> 172.21.15.103:0/1986491732 conn(0x55fa3ac71ab0 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.712+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 shutdown_connections 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.712+0000 7f518d909480 1 -- 172.21.15.103:0/1986491732 wait complete. 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.712+0000 7f518d909480 20 client.4713 trim_cache size 0 max 16384 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.712+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c006ee0 con 0x55fa3aea4800 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae02be0 con 0x55fa3aea3cc0 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ae0cd50 con 0x55fa3ad801c0 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39468/0 (socket says 172.21.15.103:39468) 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f5187bd4640 1 -- 172.21.15.103:0/3579829468 learned_addr learned my addr 172.21.15.103:0/3579829468 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.713+0000 7f51873d3640 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5187bd4640 1 -- 172.21.15.103:0/3579829468 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 msgr2=0x55fa3ad7b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5187bd4640 1 -- 172.21.15.103:0/3579829468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5187bd4640 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ad7ca30 con 0x55fa3aea4800 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7d3a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5178048040 tx=0x7f517803e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49af1ff3ea31ced server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178055080 con 0x55fa3aea4800 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517802a040 con 0x55fa3aea4800 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 10 client.4716 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aea1f00 con 0x55fa3aea4800 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f51767fc640 20 client.4716 tick 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f51767fc640 20 client.4716 collect_and_send_metrics 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f51767fc640 20 client.4716 collect_and_send_global_metrics 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f51767fc640 5 client.4716 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f51767fc640 20 client.4716 trim_cache size 0 max 16384 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f51767fc640 20 client.4716 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517800c890 con 0x55fa3aea4800 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178024b90 con 0x55fa3aea4800 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5184bce640 1 client.4716 handle_mds_map epoch 6 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 20 client.4716 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 10 client.4716 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 20 client.4716 mds is 0 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 10 client.4716 _open_mds_session mds.0 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f518d909480 10 client.4716 waiting for session to mds.0 to open 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f51873d3640 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.714+0000 7f5184bce640 10 client.4716 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.715+0000 7f51873d3640 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f82be2a6b1aec9f9 server_cookie=2697fd70eea0c08d in_seq=0 out_seq=0 2024-04-25T10:35:18.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f5184bce640 10 client.4716 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f5184bce640 10 client.4716 renew_caps mds.0 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00ad90 con 0x55fa3aeb0740 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f5184bce640 10 client.4716 connect_mds_targets for mds.0 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f518d909480 10 client.4716 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f518d909480 20 client.4716 mds is 0 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f518d909480 10 client.4716 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f518d909480 20 client.4716 encode_cap_releases enter (req: 0x55fa3ad7add0, mds: 0) 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f518d909480 20 client.4716 send_request set sent_stamp to 2024-04-25T10:35:18.717270+0000 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f518d909480 10 client.4716 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.715119+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.715119+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9eb90 con 0x55fa3aeb0740 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f518d909480 20 client.4716 awaiting reply|forward|kick on 0x7ffc16ba7a80 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00ad90 con 0x55fa3aeb0740 2024-04-25T10:35:18.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.716+0000 7f5184bce640 10 client.4716 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518000b7b0 con 0x55fa3aeb0740 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 insert_trace from 2024-04-25T10:35:18.717270+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 features 0xffffffffffffffff 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 update_snap_trace len 70 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref now is 1 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 15 client.4716 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 15 client.4716 snapc 1=[] 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 put_snap_realm 0x1 0x7f515c00a4f0 2 -> 1 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00afb0) - ctime 2024-04-25T10:35:18.699151+0000 mtime 2024-04-25T10:35:18.699151+0000 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 dir hash is 2 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 12 client.4716 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 9 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 12 client.4716 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=- has_dir_layout 0x7f515c00afb0) caps pAsLsXsFs 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref was 1 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref now is 2 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 15 client.4716 add_update_cap first one, opened snaprealm 0x7f515c00a4f0 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 put_snap_realm 0x1 0x7f515c00a4f0 2 -> 1 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 handle_client_reply signalling caller 0x7ffc16ba7a80 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 lat 0.000481 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 _ll_get 0x7f515c00afb0 0x1 -> 1 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 8 client.4716 _ll_create 0x1.head test_llreadvllwritevnegativeiovcountfile43224 0666 578, uid 0, gid 0 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 _do_lookup on #0x1/test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnegativeiovcountfile43224 => 2253161307 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 choose_target_mds 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) is_hash=1 hash=2253161307 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 mds is 0 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 encode_cap_releases enter (req: 0x55fa3ae9eb90, mds: 0) 2024-04-25T10:35:18.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 send_request set sent_stamp to 2024-04-25T10:35:18.717814+0000 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 send_request client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.717784+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.717784+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9efc0 con 0x55fa3aeb0740 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 awaiting reply|forward|kick on 0x7ffc16ba7870 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f518001ce60 con 0x55fa3aeb0740 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 insert_trace from 2024-04-25T10:35:18.717814+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 10 client.4716 insert_trace -- no trace 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 handle_client_reply signalling caller 0x7ffc16ba7870 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 lat 0.000256 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 _do_lookup res is -2 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 _lookup 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) test_llreadvllwritevnegativeiovcountfile43224 = -2 2024-04-25T10:35:18.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 may_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 _getattr mask As issued=1 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 3 client.4716 may_create 0x7f515c00afb0 = 0 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 8 client.4716 _create(0x1 test_llreadvllwritevnegativeiovcountfile43224, 0666) 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) name test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 15 open_dir 0x55fa3ad7b140 on 0x7f515c00afb0 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 15 client.4716 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) 'test_llreadvllwritevnegativeiovcountfile43224' dn 0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] (new dn) 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnegativeiovcountfile43224 => 2253161307 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) is_hash=1 hash=2253161307 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 mds is 0 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:18.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 encode_cap_releases enter (req: 0x55fa3ae9efc0, mds: 0) 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 encode_dentry_release enter(dn:0x7f515c00aca0) 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00afb0), req:0x55fa3ae9efc0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 send_request set sent_stamp to 2024-04-25T10:35:18.718120+0000 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 10 client.4716 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.718103+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.718103+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9f3a0 con 0x55fa3aeb0740 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f518d909480 20 client.4716 awaiting reply|forward|kick on 0x7ffc16ba78d0 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.717+0000 7f5184bce640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 866+0+0 (crc 0 0 0) 0x7f5180005a40 con 0x55fa3aeb0740 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 insert_trace from 2024-04-25T10:35:18.718120+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 features 0xffffffffffffffff 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 update_snap_trace len 70 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref was 1 2024-04-25T10:35:18.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref now is 2 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 hrm is_target=1 is_dentry=1 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 update_inode_file_time 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) - ctime 2024-04-25T10:35:18.718103+0000 mtime 2024-04-25T10:35:18.718103+0000 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 12 client.4716 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 12 client.4716 add_update_inode adding 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=- objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref was 2 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref now is 3 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 15 client.4716 add_update_cap first one, opened snaprealm 0x7f515c00a4f0 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 12 client.4716 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) caps pAsLsXs 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.699151+0000 ctime=2024-04-25T10:35:18.699151+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) pAsLsXs ctime 2024-04-25T10:35:18.718103+0000 mtime 2024-04-25T10:35:18.718103+0000 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 dir hash is 2 2024-04-25T10:35:18.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 12 client.4716 add_update_inode client inode change_attr: 9 , mds inodestat change_attr: 10 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 12 client.4716 insert_dentry_inode 'test_llreadvllwritevnegativeiovcountfile43224' vino 0x10000000005.head in dir 0x1.head dn 0x7f515c00aca0 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 15 client.4716 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 'test_llreadvllwritevnegativeiovcountfile43224' to inode 0x7f515c00b590 dn 0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] (old dn) 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 link inode 0x7f515c00b590 parents now 0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 15 client.4716 update_dentry_lease 0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] lease(mask 7 dur 30000) from 2024-04-25T10:35:18.718120+0000 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 10 client.4716 got dentry lease on test_llreadvllwritevnegativeiovcountfile43224 dur 30000ms ttl 2024-04-25T10:35:48.718120+0000 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 put_snap_realm 0x1 0x7f515c00a4f0 3 -> 2 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 handle_client_reply signalling caller 0x7ffc16ba78d0 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 20 client.4716 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 10 client.4716 delegated_inos: [] 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 10 client.4716 make_request created ino 0x10000000005 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 20 client.4716 make_request target is 0x10000000005.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 20 client.4716 lat 0.003302 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000005.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000005.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 10 client.4716 _create_fh 0x10000000005 mode 3 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 20 client.4716 trim_cache size 1 max 16384 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 8 client.4716 create(#0x1/test_llreadvllwritevnegativeiovcountfile43224, 0100666 layout 0 0 0) = 0 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 20 client.4716 _ll_create created = 1 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 8 client.4716 _ll_create 0x1.head test_llreadvllwritevnegativeiovcountfile43224 0666 578 = 0 (0x55fa3ad7efb0 10000000005) 2024-04-25T10:35:18.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 20 client.4716 _ll_get 0x7f515c00b590 0x10000000005 -> 1 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 10 client.4716 fill_statx on 0x10000000005 snap/devhead mode 0100666 mtime 2024-04-25T10:35:18.718103+0000 ctime 2024-04-25T10:35:18.718103+0000 change_attr 0 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.720+0000 7f5184bce640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 3 client.4716 ll_release (fh)0x55fa3ad7efb0 0x10000000005 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 8 client.4716 _release_fh 0x55fa3ad7efb0 mode 3 on 0x10000000005.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 _flush 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 nothing to flush 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 check_caps on 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 delaying cap release 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 cap_delay_requeue on 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 _release_fh 0x55fa3ad7efb0 on inode 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) no async_err state 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 3 client.4716 ll_unlink 0x1.head test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 may_delete 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0); ; name test_llreadvllwritevnegativeiovcountfile43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 _getattr mask As issued=1 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 3 client.4716 may_delete 0x7f515c00afb0 = 0 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 8 client.4716 _unlink(0x1 test_llreadvllwritevnegativeiovcountfile43224 uid 0 gid 0) 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 get_or_create 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) name test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 _lookup have 0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] from mds.0 ttl 2024-04-25T10:35:48.718120+0000 seq 2 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 _lookup 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) test_llreadvllwritevnegativeiovcountfile43224 = 0x10000000005.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnegativeiovcountfile43224 => 2253161307 2024-04-25T10:35:18.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 choose_target_mds 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) is_hash=1 hash=2253161307 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 choose_target_mds from dirfragtree hash 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 mds is 0 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 send_request rebuilding request 4 for mds.0 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 encode_cap_releases enter (req: 0x55fa3ae9f3a0, mds: 0) 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 encode_inode_release enter(in:0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590), req:0x55fa3ae9f3a0 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 encode_dentry_release enter(dn:0x7f515c00aca0) 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0), req:0x55fa3ae9f3a0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 send_request set sent_stamp to 2024-04-25T10:35:18.721682+0000 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 10 client.4716 send_request client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.721637+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevnegativeiovcountfile43224 2024-04-25T10:35:18.721637+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9f780 con 0x55fa3aeb0740 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f518d909480 20 client.4716 awaiting reply|forward|kick on 0x7ffc16ba7aa0 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(revoke ino 0x10000000005 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.718103+0000 ctime 2024-04-25T10:35:18.718103+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f518005e4f0 con 0x55fa3aeb0740 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 5 client.4716 set_cap_epoch_barrier epoch = 20 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 10 client.4716 mds.0 seq now 1 2024-04-25T10:35:18.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 5 client.4716 handle_cap_grant on in 0x10000000005 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 10 client.4716 update_inode_file_time 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:18.718103+0000 mtime 2024-04-25T10:35:18.718103+0000 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 10 client.4716 revocation of AxXx 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 10 client.4716 check_caps on 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) wanted - used - issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 10 client.4716 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 10 client.4716 completed revocation of AxXx 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 10 client.4716 send_cap 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] 0x7f515c00b590) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsxFsxcrwb revoking AxXx dropping Fxcrwb 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 15 client.4716 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000005 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.718103+0000 ctime 2024-04-25T10:35:18.718103+0000 change_attr 0) -- 0x7f515c00bb70 con 0x55fa3aeb0740 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.721+0000 7f5184bce640 10 client.4716 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:4 = 0 (0) Success unsafe) ==== 514+0+0 (crc 0 0 0) 0x7f5180045be0 con 0x55fa3aeb0740 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 handle_client_reply got a reply. Safe:0 tid 4 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 10 client.4716 insert_trace from 2024-04-25T10:35:18.721682+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 10 client.4716 features 0xffffffffffffffff 2024-04-25T10:35:18.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 10 client.4716 update_snap_trace len 70 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref was 2 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 get_snap_realm 0x1 0x7f515c00a4f0, nref now is 3 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 10 client.4716 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 10 client.4716 hrm is_target=0 is_dentry=1 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 12 client.4716 add_update_inode had 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) caps pAsLsXs 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 10 client.4716 update_inode_file_time 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) pAsLsXs ctime 2024-04-25T10:35:18.721637+0000 mtime 2024-04-25T10:35:18.718103+0000 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 dir hash is 2 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 12 client.4716 add_update_inode client inode change_attr: 10 , mds inodestat change_attr: 11 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 10 client.4716 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 15 client.4716 unlink dir 0x7f515c00afb0 'test_llreadvllwritevnegativeiovcountfile43224' dn 0x7f515c00aca0 inode 0x7f515c00b590 2024-04-25T10:35:18.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 unlink inode 0x7f515c00b590 parents now 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 15 client.4716 update_dentry_lease 0x1.head["test_llreadvllwritevnegativeiovcountfile43224"] lease(mask 3 dur 30000) from 2024-04-25T10:35:18.721682+0000 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 10 client.4716 got dentry lease on test_llreadvllwritevnegativeiovcountfile43224 dur 30000ms ttl 2024-04-25T10:35:48.721682+0000 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 put_snap_realm 0x1 0x7f515c00a4f0 3 -> 2 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 handle_client_reply signalling caller 0x7ffc16ba7aa0 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f5184bce640 20 client.4716 handle_client_reply awaiting kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 20 client.4716 sendrecv kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 20 client.4716 lat 0.001699 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 20 client.4716 trim_cache size 1 max 16384 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 8 client.4716 unlink(#0x1/test_llreadvllwritevnegativeiovcountfile43224) = 0 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 2 client.4716 unmount 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 2 client.4716 unmounting 2024-04-25T10:35:18.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3ad7b9f0 con 0x55fa3aeb0740 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.722+0000 7f518d909480 10 client.4716 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(grant ino 0x10000000005 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.718103+0000 ctime 2024-04-25T10:35:18.721637+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f515c00bb70 con 0x55fa3aeb0740 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 mds.0 seq now 2 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 5 client.4716 handle_cap_grant on in 0x10000000005 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 update_inode_file_time 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.718103+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) pAsXsFs ctime 2024-04-25T10:35:18.721637+0000 mtime 2024-04-25T10:35:18.718103+0000 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 max_size 4194304 -> 0 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 grant, new caps are LsFxcrwb 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 5 client.4716 _try_to_trim_inode in 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 20 client.4716 trim_cache size 1 max 16384 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 unmounting: trim pass, size still 1+2 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_reply(???:4 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f518000a040 con 0x55fa3aeb0740 2024-04-25T10:35:18.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 20 client.4716 handle_client_reply got a reply. Safe:1 tid 4 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 insert_trace from 2024-04-25T10:35:18.721682+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 unmounting: trim pass, size was 1+2 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 20 client.4716 trim_cache size 1 max 16384 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 15 client.4716 trim_dentry unlinking dn test_llreadvllwritevnegativeiovcountfile43224 in dir 0x1 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 15 client.4716 unlink dir 0x7f515c00afb0 'test_llreadvllwritevnegativeiovcountfile43224' dn 0x7f515c00aca0 inode 0 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 15 client.4716 unlink removing 'test_llreadvllwritevnegativeiovcountfile43224' dn 0x7f515c00aca0 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 15 client.4716 close_dir dir 0x55fa3ad7b140 on 0x7f515c00afb0 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _ll_drop_pins 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 _ll_put 0x7f515c00b590 0x10000000005 1 -> 0 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 _ll_put 0x7f515c00afb0 0x1 2 -> 0 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 _release 0x10000000005.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _invalidate_inode_cache 0x10000000005.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _flush 0x10000000005.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 nothing to flush 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 _release 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _flush 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 nothing to flush 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x10000000005.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 1 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 1 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 flush_caps_sync 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 trim_cache size 0 max 16384 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) n = 12 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 15 client.4716 remove_cap last one, closing snaprealm 0x7f515c00a4f0 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_snap_realm 0x1 0x7f515c00a4f0 2 -> 1 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=- has_dir_layout 0x7f515c00afb0) 2024-04-25T10:35:18.952 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _put_inode on 0x10000000005.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) n = 15 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 remove_cap mds.0 on 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 15 client.4716 remove_cap last one, closing snaprealm 0x7f515c00a4f0 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 20 client.4716 put_snap_realm 0x1 0x7f515c00a4f0 1 -> 0 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 10 client.4716 _put_inode deleting 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.718103+0000 mtime=2024-04-25T10:35:18.718103+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=1 caps=- objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b590) 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 2 client.4716 _close_mds_session mds.0 seq 2 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 2) -- 0x55fa3ae9f780 con 0x55fa3aeb0740 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f518d909480 2 client.4716 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_caps(grant ino 0x10000000005 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.718103+0000 ctime 2024-04-25T10:35:18.721637+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f518000a230 con 0x55fa3aeb0740 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 mds.0 seq now 3 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 3) -- 0x7f515c00ad90 con 0x55fa3aeb0740 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 5 client.4716 handle_caps don't have vino 0x10000000005.head op 0, immediately releasing 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_cap_release(3) -- 0x55fa3aea4350 con 0x55fa3aeb0740 2024-04-25T10:35:18.953 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 20 client.4716 trim_cache size 0 max 16384 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.726+0000 7f5184bce640 10 client.4716 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x7f515c00ad90 con 0x55fa3aeb0740 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 10 client.4716 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 5 client.4716 _closed_mds_session mds.0 seq 3 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 1 -- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 msgr2=0x55fa3ad7a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 10 client.4716 remove_session_caps mds.0 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 10 client.4716 kick_requests_closed for mds.0 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 10 client.4716 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 20 client.4716 trim_cache size 0 max 16384 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f5184bce640 10 client.4716 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 2 client.4716 unmounted. 2024-04-25T10:35:18.954 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 client.4716 shutdown 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 msgr2=0x55fa3ad7d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7d3a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5178048040 tx=0x7f517803e040 comp rx=0 tx=0).stop 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 shutdown_connections 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7d3a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 --2- 172.21.15.103:0/3579829468 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3ad7b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 >> 172.21.15.103:0/3579829468 conn(0x55fa3ac71ab0 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 shutdown_connections 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 1 -- 172.21.15.103:0/3579829468 wait complete. 2024-04-25T10:35:18.955 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.728+0000 7f518d909480 20 client.4716 trim_cache size 0 max 16384 2024-04-25T10:35:18.956 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.LlreadvLlwritevNegativeIOVCount (25 ms) 2024-04-25T10:35:18.956 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.LlreadvLlwritevZeroBytes 2024-04-25T10:35:18.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.729+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c008610 con 0x55fa3aea4800 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad7c790 con 0x55fa3ad801c0 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeb1280 con 0x55fa3aea3cc0 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39478/0 (socket says 172.21.15.103:39478) 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 -- 172.21.15.103:0/3278288006 learned_addr learned my addr 172.21.15.103:0/3278288006 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f51873d3640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 -- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 -- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3ad7d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 -- 172.21.15.103:0/3278288006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aea20d0 con 0x55fa3aea4800 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7b420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5178053040 tx=0x7f517803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877d5802ce470ebe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.730+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178055070 con 0x55fa3aea4800 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517800e040 con 0x55fa3aea4800 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 10 client.4719 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae0c7d0 con 0x55fa3aea4800 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5175ffb640 20 client.4719 tick 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5175ffb640 20 client.4719 collect_and_send_metrics 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5175ffb640 20 client.4719 collect_and_send_global_metrics 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5175ffb640 5 client.4719 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5175ffb640 20 client.4719 trim_cache size 0 max 16384 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5175ffb640 20 client.4719 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517800add0 con 0x55fa3aea4800 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178046970 con 0x55fa3aea4800 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5185bd0640 1 client.4719 handle_mds_map epoch 6 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 20 client.4719 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 10 client.4719 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 20 client.4719 mds is 0 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 10 client.4719 _open_mds_session mds.0 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f518d909480 10 client.4719 waiting for session to mds.0 to open 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f51873d3640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.731+0000 7f5185bd0640 10 client.4719 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.732+0000 7f51873d3640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=264b05d5f5acdc70 server_cookie=1ec5cd209d258fc2 in_seq=0 out_seq=0 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f5185bd0640 10 client.4719 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f5185bd0640 10 client.4719 renew_caps mds.0 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00ad20 con 0x55fa3aeb0740 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f5185bd0640 10 client.4719 connect_mds_targets for mds.0 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f518d909480 10 client.4719 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f518d909480 20 client.4719 mds is 0 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f518d909480 10 client.4719 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f518d909480 20 client.4719 encode_cap_releases enter (req: 0x55fa3ae9fa60, mds: 0) 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f518d909480 20 client.4719 send_request set sent_stamp to 2024-04-25T10:35:18.734229+0000 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f518d909480 10 client.4719 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.731854+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.731854+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeab960 con 0x55fa3aeb0740 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f518d909480 20 client.4719 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00ad20 con 0x55fa3aeb0740 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.733+0000 7f5185bd0640 10 client.4719 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180000bc0 con 0x55fa3aeb0740 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 insert_trace from 2024-04-25T10:35:18.734229+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 features 0xffffffffffffffff 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 update_snap_trace len 70 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 get_snap_realm 0x1 0x7f515c00af40, nref now is 1 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 15 client.4719 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 15 client.4719 snapc 1=[] 2024-04-25T10:35:18.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 put_snap_realm 0x1 0x7f515c00af40 2 -> 1 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b030) - ctime 2024-04-25T10:35:18.721637+0000 mtime 2024-04-25T10:35:18.721637+0000 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 dir hash is 2 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 12 client.4719 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 11 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 12 client.4719 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=- has_dir_layout 0x7f515c00b030) caps pAsLsXsFs 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 get_snap_realm 0x1 0x7f515c00af40, nref was 1 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 get_snap_realm 0x1 0x7f515c00af40, nref now is 2 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 15 client.4719 add_update_cap first one, opened snaprealm 0x7f515c00af40 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 put_snap_realm 0x1 0x7f515c00af40 2 -> 1 2024-04-25T10:35:18.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 lat 0.000383 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 _ll_get 0x7f515c00b030 0x1 -> 1 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 2 client.4719 unmount 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 1 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 1 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 unmounting: trim pass, size was 0+1 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 20 client.4719 trim_cache size 0 max 16384 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f5185bd0640 10 client.4719 unmounting: trim pass, size still 0+1 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 2 client.4719 unmounting 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 1 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 1 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 _ll_drop_pins 2024-04-25T10:35:18.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 _ll_put 0x7f515c00b030 0x1 1 -> 0 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 1 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 1 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 nothing to flush 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 1 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 1 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 flush_caps_sync 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 trim_cache size 0 max 16384 2024-04-25T10:35:18.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) n = 8 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b030) 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 15 client.4719 remove_cap last one, closing snaprealm 0x7f515c00af40 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 20 client.4719 put_snap_realm 0x1 0x7f515c00af40 1 -> 0 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 10 client.4719 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=- has_dir_layout 0x7f515c00b030) 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 2 client.4719 _close_mds_session mds.0 seq 0 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3aeae010 con 0x55fa3aeb0740 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.734+0000 7f518d909480 2 client.4719 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aeae010 con 0x55fa3aeb0740 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 10 client.4719 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 5 client.4719 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 1 -- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 msgr2=0x55fa3ad7a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 10 client.4719 remove_session_caps mds.0 2024-04-25T10:35:18.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 10 client.4719 kick_requests_closed for mds.0 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 10 client.4719 unmounting: trim pass, size was 0+0 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 20 client.4719 trim_cache size 0 max 16384 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f5185bd0640 10 client.4719 unmounting: trim pass, size still 0+0 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 2 client.4719 unmounted. 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 client.4719 shutdown 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 msgr2=0x55fa3ad7b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7b420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5178053040 tx=0x7f517803b000 comp rx=0 tx=0).stop 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 shutdown_connections 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 --2- 172.21.15.103:0/3278288006 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 >> 172.21.15.103:0/3278288006 conn(0x55fa3ac71ab0 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.735+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 shutdown_connections 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.736+0000 7f518d909480 1 -- 172.21.15.103:0/3278288006 wait complete. 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.736+0000 7f518d909480 20 client.4719 trim_cache size 0 max 16384 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.736+0000 7f518d909480 1 -- start start 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c0046c0 con 0x55fa3ad801c0 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3adffc70 con 0x55fa3aea3cc0 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeab390 con 0x55fa3aea4800 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39488/0 (socket says 172.21.15.103:39488) 2024-04-25T10:35:18.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f51873d3640 1 -- 172.21.15.103:0/3768677167 learned_addr learned my addr 172.21.15.103:0/3768677167 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.737+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51873d3640 1 -- 172.21.15.103:0/3768677167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea4800 msgr2=0x55fa3ad7b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51873d3640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea4800 0x55fa3ad7b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51873d3640 1 -- 172.21.15.103:0/3768677167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51873d3640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51873d3640 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3adf7170 con 0x55fa3ad801c0 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51873d3640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5180062fd0 tx=0x55fa3aeb8390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd021c31370c49e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180093040 con 0x55fa3ad801c0 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5180000bc0 con 0x55fa3ad801c0 2024-04-25T10:35:18.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 10 client.4722 Subscribing to map 'mdsmap' 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ad79610 con 0x55fa3ad801c0 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51767fc640 20 client.4722 tick 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51767fc640 20 client.4722 collect_and_send_metrics 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51767fc640 20 client.4722 collect_and_send_global_metrics 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51767fc640 5 client.4722 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51767fc640 20 client.4722 trim_cache size 0 max 16384 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f51767fc640 20 client.4722 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3aea4350 con 0x55fa3ad801c0 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066040 con 0x55fa3ad801c0 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f5184bce640 1 client.4722 handle_mds_map epoch 6 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 20 client.4722 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 10 client.4722 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 20 client.4722 mds is 0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 10 client.4722 _open_mds_session mds.0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f518d909480 10 client.4722 waiting for session to mds.0 to open 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.738+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.739+0000 7f5184bce640 10 client.4722 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.739+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39b228e1586bf42a server_cookie=85b06593e8fa2bcf in_seq=0 out_seq=0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aeb0740 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 renew_caps mds.0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00ad00 con 0x55fa3aeb0740 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 connect_mds_targets for mds.0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 mds is 0 2024-04-25T10:35:18.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 encode_cap_releases enter (req: 0x55fa3aea6380, mds: 0) 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 send_request set sent_stamp to 2024-04-25T10:35:18.741584+0000 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.739174+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.739174+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad7c920 con 0x55fa3aeb0740 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 awaiting reply|forward|kick on 0x7ffc16ba7aa0 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00ad00 con 0x55fa3aeb0740 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c036040 con 0x55fa3aeb0740 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 insert_trace from 2024-04-25T10:35:18.741584+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 features 0xffffffffffffffff 2024-04-25T10:35:18.989 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 update_snap_trace len 70 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref now is 1 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 15 client.4722 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 15 client.4722 snapc 1=[] 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 put_snap_realm 0x1 0x7f515c00af20 2 -> 1 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 hrm is_target=1 is_dentry=0 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b010) - ctime 2024-04-25T10:35:18.721637+0000 mtime 2024-04-25T10:35:18.721637+0000 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 dir hash is 2 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 12 client.4722 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 11 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 12 client.4722 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=- has_dir_layout 0x7f515c00b010) caps pAsLsXsFs 2024-04-25T10:35:18.990 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref was 1 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref now is 2 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 15 client.4722 add_update_cap first one, opened snaprealm 0x7f515c00af20 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 put_snap_realm 0x1 0x7f515c00af20 2 -> 1 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 handle_client_reply signalling caller 0x7ffc16ba7aa0 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 lat 0.000356 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 _ll_get 0x7f515c00b010 0x1 -> 1 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 8 client.4722 _ll_create 0x1.head test_llreadvllwritevzerobytesfile43224 0666 578, uid 0, gid 0 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 _do_lookup on #0x1/test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:18.991 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 choose_target_mds inode dir hash is 2 on test_llreadvllwritevzerobytesfile43224 => 2280814475 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 choose_target_mds 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) is_hash=1 hash=2280814475 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 mds is 0 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 encode_cap_releases enter (req: 0x55fa3ad7c920, mds: 0) 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 send_request set sent_stamp to 2024-04-25T10:35:18.741987+0000 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 send_request client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:18.741965+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:18.741965+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9eb90 con 0x55fa3aeb0740 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 awaiting reply|forward|kick on 0x7ffc16ba7890 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f517c0167f0 con 0x55fa3aeb0740 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 insert_trace from 2024-04-25T10:35:18.741987+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:18.992 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 10 client.4722 insert_trace -- no trace 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 handle_client_reply signalling caller 0x7ffc16ba7890 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 lat 0.000224 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 _do_lookup res is -2 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 _lookup 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) test_llreadvllwritevzerobytesfile43224 = -2 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 may_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 _getattr mask As issued=1 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 3 client.4722 may_create 0x7f515c00b010 = 0 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 8 client.4722 _create(0x1 test_llreadvllwritevzerobytesfile43224, 0666) 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) name test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 15 open_dir 0x55fa3ad805f0 on 0x7f515c00b010 2024-04-25T10:35:18.993 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 15 client.4722 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) 'test_llreadvllwritevzerobytesfile43224' dn 0x1.head["test_llreadvllwritevzerobytesfile43224"] (new dn) 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 choose_target_mds inode dir hash is 2 on test_llreadvllwritevzerobytesfile43224 => 2280814475 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) is_hash=1 hash=2280814475 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 mds is 0 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 encode_cap_releases enter (req: 0x55fa3ae9eb90, mds: 0) 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 encode_dentry_release enter(dn:0x7f515c00a4f0) 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b010), req:0x55fa3ae9eb90 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 send_request set sent_stamp to 2024-04-25T10:35:18.742258+0000 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 10 client.4722 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:18.742241+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:18.994 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:18.742241+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9ef80 con 0x55fa3aeb0740 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f518d909480 20 client.4722 awaiting reply|forward|kick on 0x7ffc16ba78f0 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.741+0000 7f5184bce640 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 859+0+0 (crc 0 0 0) 0x7f517c000bc0 con 0x55fa3aeb0740 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 insert_trace from 2024-04-25T10:35:18.742258+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 features 0xffffffffffffffff 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 update_snap_trace len 70 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref was 1 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref now is 2 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 hrm is_target=1 is_dentry=1 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 update_inode_file_time 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) - ctime 2024-04-25T10:35:18.742241+0000 mtime 2024-04-25T10:35:18.742241+0000 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 12 client.4722 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:18.995 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 12 client.4722 add_update_inode adding 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=- objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref was 2 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref now is 3 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 15 client.4722 add_update_cap first one, opened snaprealm 0x7f515c00af20 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 add_update_cap calling signal_caps_inode 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 12 client.4722 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) caps pAsLsXs 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.721637+0000 ctime=2024-04-25T10:35:18.721637+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) pAsLsXs ctime 2024-04-25T10:35:18.742241+0000 mtime 2024-04-25T10:35:18.742241+0000 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 dir hash is 2 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 12 client.4722 add_update_inode client inode change_attr: 11 , mds inodestat change_attr: 12 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 12 client.4722 insert_dentry_inode 'test_llreadvllwritevzerobytesfile43224' vino 0x10000000006.head in dir 0x1.head dn 0x7f515c00a4f0 2024-04-25T10:35:18.996 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 15 client.4722 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) 'test_llreadvllwritevzerobytesfile43224' to inode 0x7f515c00b5f0 dn 0x1.head["test_llreadvllwritevzerobytesfile43224"] (old dn) 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 link inode 0x7f515c00b5f0 parents now 0x1.head["test_llreadvllwritevzerobytesfile43224"] 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 15 client.4722 update_dentry_lease 0x1.head["test_llreadvllwritevzerobytesfile43224"] lease(mask 7 dur 30000) from 2024-04-25T10:35:18.742258+0000 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 got dentry lease on test_llreadvllwritevzerobytesfile43224 dur 30000ms ttl 2024-04-25T10:35:48.742258+0000 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 put_snap_realm 0x1 0x7f515c00af20 3 -> 2 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 handle_client_reply signalling caller 0x7ffc16ba78f0 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 20 client.4722 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 10 client.4722 delegated_inos: [] 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 10 client.4722 make_request created ino 0x10000000006 2024-04-25T10:35:18.997 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 20 client.4722 make_request target is 0x10000000006.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 20 client.4722 lat 0.002413 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000006.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000006.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 10 client.4722 _create_fh 0x10000000006 mode 3 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 20 client.4722 trim_cache size 1 max 16384 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 8 client.4722 create(#0x1/test_llreadvllwritevzerobytesfile43224, 0100666 layout 0 0 0) = 0 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 20 client.4722 _ll_create created = 1 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 8 client.4722 _ll_create 0x1.head test_llreadvllwritevzerobytesfile43224 0666 578 = 0 (0x55fa3ad7efb0 10000000006) 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 20 client.4722 _ll_get 0x7f515c00b5f0 0x10000000006 -> 1 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 10 client.4722 fill_statx on 0x10000000006 snap/devhead mode 0100666 mtime 2024-04-25T10:35:18.742241+0000 ctime 2024-04-25T10:35:18.742241+0000 change_attr 0 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:18.998 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 3 client.4722 pwritev(0x55fa3ad7efb0, "...", 0, 0) = -22 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3ae9f360 0x55fa3adf3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] -- osd_op(unknown.0.0:1 3.25 3:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x55fa3adf38d0 con 0x55fa3ae9f360 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] -- osd_op(unknown.0.0:2 3.25 3:a5feb6f3:::10000000006.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x55fa3adf4260 con 0x55fa3ae9f360 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3ae9f360 0x55fa3adf3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5184bce640 10 client.4722 ms_handle_connect on v2:172.21.15.103:6816/1963339576 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3ae9f360 0x55fa3adf3320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=e28fb6c38814998b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.744+0000 7f5187bd4640 1 -- 172.21.15.103:0/3768677167 <== osd.1 v2:172.21.15.103:6816/1963339576 1 ==== osd_op_reply(1 10000000006.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3ae9f360 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f5187bd4640 1 -- 172.21.15.103:0/3768677167 <== osd.1 v2:172.21.15.103:6816/1963339576 2 ==== osd_op_reply(2 10000000006.00000000 [create] v22'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178012480 con 0x55fa3ae9f360 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 10 client.4722 get_caps 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 10 client.4722 _read_async 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=1} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 0~0 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 3 client.4722 preadv(0x55fa3ad7efb0, 0) = 0 2024-04-25T10:35:18.999 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 3 client.4722 ll_release (fh)0x55fa3ad7efb0 0x10000000006 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 8 client.4722 _release_fh 0x55fa3ad7efb0 mode 3 on 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 10 client.4722 _flush 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 10 client.4722 nothing to flush 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 10 client.4722 check_caps on 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.745+0000 7f518d909480 10 client.4722 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 client.4722 delaying cap release 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 client.4722 cap_delay_requeue on 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 client.4722 _release_fh 0x55fa3ad7efb0 on inode 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) no async_err state 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 3 client.4722 ll_unlink 0x1.head test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 may_delete 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010); ; name test_llreadvllwritevzerobytesfile43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 client.4722 _getattr mask As issued=1 2024-04-25T10:35:19.000 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 3 client.4722 may_delete 0x7f515c00b010 = 0 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 8 client.4722 _unlink(0x1 test_llreadvllwritevzerobytesfile43224 uid 0 gid 0) 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 get_or_create 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) name test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 _lookup have 0x1.head["test_llreadvllwritevzerobytesfile43224"] from mds.0 ttl 2024-04-25T10:35:48.742258+0000 seq 2 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 client.4722 _lookup 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) test_llreadvllwritevzerobytesfile43224 = 0x10000000006.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 choose_target_mds inode dir hash is 2 on test_llreadvllwritevzerobytesfile43224 => 2280814475 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 choose_target_mds 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) is_hash=1 hash=2280814475 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 client.4722 choose_target_mds from dirfragtree hash 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 mds is 0 2024-04-25T10:35:19.001 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 client.4722 send_request rebuilding request 4 for mds.0 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 encode_cap_releases enter (req: 0x55fa3adf38d0, mds: 0) 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 encode_inode_release enter(in:0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0), req:0x55fa3adf38d0 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 encode_dentry_release enter(dn:0x7f515c00a4f0) 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010), req:0x55fa3adf38d0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 send_request set sent_stamp to 2024-04-25T10:35:18.746570+0000 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 10 client.4722 send_request client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:18.746548+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevzerobytesfile43224 2024-04-25T10:35:18.746548+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf4260 con 0x55fa3aeb0740 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f518d909480 20 client.4722 awaiting reply|forward|kick on 0x7ffc16ba7ac0 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(revoke ino 0x10000000006 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.742241+0000 ctime 2024-04-25T10:35:18.742241+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c064040 con 0x55fa3aeb0740 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 5 client.4722 set_cap_epoch_barrier epoch = 20 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 10 client.4722 mds.0 seq now 1 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 5 client.4722 handle_cap_grant on in 0x10000000006 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:19.002 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 10 client.4722 update_inode_file_time 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:18.742241+0000 mtime 2024-04-25T10:35:18.742241+0000 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 10 client.4722 revocation of AxXx 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 10 client.4722 check_caps on 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) wanted - used - issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 10 client.4722 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 10 client.4722 completed revocation of AxXx 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 10 client.4722 send_cap 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile43224"] 0x7f515c00b5f0) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsxFsxcrwb revoking AxXx dropping Fxcrwb 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 15 client.4722 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000006 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.742241+0000 ctime 2024-04-25T10:35:18.742241+0000 change_attr 0) -- 0x7f515c00bbd0 con 0x55fa3aeb0740 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.746+0000 7f5184bce640 10 client.4722 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:4 = 0 (0) Success unsafe) ==== 507+0+0 (crc 0 0 0) 0x7f517c018a30 con 0x55fa3aeb0740 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 handle_client_reply got a reply. Safe:0 tid 4 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 10 client.4722 insert_trace from 2024-04-25T10:35:18.746570+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 10 client.4722 features 0xffffffffffffffff 2024-04-25T10:35:19.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 10 client.4722 update_snap_trace len 70 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref was 2 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 get_snap_realm 0x1 0x7f515c00af20, nref now is 3 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 10 client.4722 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 10 client.4722 hrm is_target=0 is_dentry=1 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 12 client.4722 add_update_inode had 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) caps pAsLsXs 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 10 client.4722 update_inode_file_time 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) pAsLsXs ctime 2024-04-25T10:35:18.746548+0000 mtime 2024-04-25T10:35:18.742241+0000 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 dir hash is 2 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 12 client.4722 add_update_inode client inode change_attr: 12 , mds inodestat change_attr: 13 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 10 client.4722 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 15 client.4722 unlink dir 0x7f515c00b010 'test_llreadvllwritevzerobytesfile43224' dn 0x7f515c00a4f0 inode 0x7f515c00b5f0 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 unlink inode 0x7f515c00b5f0 parents now 2024-04-25T10:35:19.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 15 client.4722 update_dentry_lease 0x1.head["test_llreadvllwritevzerobytesfile43224"] lease(mask 3 dur 30000) from 2024-04-25T10:35:18.746570+0000 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 10 client.4722 got dentry lease on test_llreadvllwritevzerobytesfile43224 dur 30000ms ttl 2024-04-25T10:35:48.746570+0000 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 put_snap_realm 0x1 0x7f515c00af20 3 -> 2 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 handle_client_reply signalling caller 0x7ffc16ba7ac0 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f5184bce640 20 client.4722 handle_client_reply awaiting kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 20 client.4722 sendrecv kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 20 client.4722 lat 0.001151 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 20 client.4722 trim_cache size 1 max 16384 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 8 client.4722 unlink(#0x1/test_llreadvllwritevzerobytesfile43224) = 0 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 2 client.4722 unmount 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 2 client.4722 unmounting 2024-04-25T10:35:19.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x7f5178012a40 con 0x55fa3aeb0740 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.747+0000 7f518d909480 10 client.4722 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(grant ino 0x10000000006 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.742241+0000 ctime 2024-04-25T10:35:18.746548+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f515c00bbd0 con 0x55fa3aeb0740 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 mds.0 seq now 2 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 5 client.4722 handle_cap_grant on in 0x10000000006 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 update_inode_file_time 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.742241+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) pAsXsFs ctime 2024-04-25T10:35:18.746548+0000 mtime 2024-04-25T10:35:18.742241+0000 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 max_size 4194304 -> 0 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 grant, new caps are LsFxcrwb 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 5 client.4722 _try_to_trim_inode in 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 unmounting: trim pass, size was 1+2 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 20 client.4722 trim_cache size 1 max 16384 2024-04-25T10:35:19.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 unmounting: trim pass, size still 1+2 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_reply(???:4 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f517c030430 con 0x55fa3aeb0740 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 20 client.4722 handle_client_reply got a reply. Safe:1 tid 4 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 insert_trace from 2024-04-25T10:35:18.746570+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 unmounting: trim pass, size was 1+2 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 20 client.4722 trim_cache size 1 max 16384 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 15 client.4722 trim_dentry unlinking dn test_llreadvllwritevzerobytesfile43224 in dir 0x1 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 15 client.4722 unlink dir 0x7f515c00b010 'test_llreadvllwritevzerobytesfile43224' dn 0x7f515c00a4f0 inode 0 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 15 client.4722 unlink removing 'test_llreadvllwritevzerobytesfile43224' dn 0x7f515c00a4f0 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 15 client.4722 close_dir dir 0x55fa3ad805f0 on 0x7f515c00b010 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f5184bce640 10 client.4722 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:19.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 10 client.4722 _ll_drop_pins 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 _ll_put 0x7f515c00b5f0 0x10000000006 1 -> 0 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 _ll_put 0x7f515c00b010 0x1 2 -> 0 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 _release 0x10000000006.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 10 client.4722 _invalidate_inode_cache 0x10000000006.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 10 client.4722 _flush 0x10000000006.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 10 client.4722 nothing to flush 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 _release 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 10 client.4722 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 10 client.4722 _flush 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 10 client.4722 nothing to flush 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.749+0000 7f518d909480 20 client.4722 put_inode on 0x10000000006.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 1 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 1 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 10 client.4722 flush_caps_sync 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 10 client.4722 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 20 client.4722 trim_cache size 0 max 16384 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 10 client.4722 _put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) n = 12 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 10 client.4722 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 15 client.4722 remove_cap last one, closing snaprealm 0x7f515c00af20 2024-04-25T10:35:19.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 20 client.4722 put_snap_realm 0x1 0x7f515c00af20 2 -> 1 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 10 client.4722 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=- has_dir_layout 0x7f515c00b010) 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 10 client.4722 _put_inode on 0x10000000006.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) n = 15 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 10 client.4722 remove_cap mds.0 on 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 15 client.4722 remove_cap last one, closing snaprealm 0x7f515c00af20 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 20 client.4722 put_snap_realm 0x1 0x7f515c00af20 1 -> 0 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 10 client.4722 _put_inode deleting 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.742241+0000 mtime=2024-04-25T10:35:18.742241+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=1 caps=- objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b5f0) 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 2 client.4722 _close_mds_session mds.0 seq 2 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 2) -- 0x55fa3adf3d20 con 0x55fa3aeb0740 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_caps(grant ino 0x10000000006 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.742241+0000 ctime 2024-04-25T10:35:18.746548+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f517c030620 con 0x55fa3aeb0740 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f518d909480 2 client.4722 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f5184bce640 10 client.4722 mds.0 seq now 3 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 3) -- 0x7f515c00ad00 con 0x55fa3aeb0740 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f5184bce640 5 client.4722 handle_caps don't have vino 0x10000000006.head op 0, immediately releasing 2024-04-25T10:35:19.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_cap_release(3) -- 0x55fa3adf4260 con 0x55fa3aeb0740 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f5184bce640 10 client.4722 unmounting: trim pass, size was 0+0 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f5184bce640 20 client.4722 trim_cache size 0 max 16384 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.750+0000 7f5184bce640 10 client.4722 unmounting: trim pass, size still 0+0 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x7f515c00ad00 con 0x55fa3aeb0740 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 10 client.4722 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 5 client.4722 _closed_mds_session mds.0 seq 3 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 1 -- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 msgr2=0x55fa3ad7a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb0740 0x55fa3ad7a360 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 10 client.4722 remove_session_caps mds.0 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 10 client.4722 kick_requests_closed for mds.0 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 10 client.4722 unmounting: trim pass, size was 0+0 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 20 client.4722 trim_cache size 0 max 16384 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5184bce640 10 client.4722 unmounting: trim pass, size still 0+0 2024-04-25T10:35:19.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 2 client.4722 unmounted. 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 client.4722 shutdown 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3ae9f360 msgr2=0x55fa3adf3320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3ae9f360 0x55fa3adf3320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3ad7d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 --2- 172.21.15.103:0/3768677167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7d3a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5180062fd0 tx=0x55fa3aeb8390 comp rx=0 tx=0).stop 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f5187bd4640 1 -- 172.21.15.103:0/3768677167 reap_dead start 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 shutdown_connections 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 >> 172.21.15.103:0/3768677167 conn(0x55fa3ac71ab0 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 shutdown_connections 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 1 -- 172.21.15.103:0/3768677167 wait complete. 2024-04-25T10:35:19.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.751+0000 7f518d909480 20 client.4722 trim_cache size 0 max 16384 2024-04-25T10:35:19.013 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.LlreadvLlwritevZeroBytes (23 ms) 2024-04-25T10:35:19.013 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.LlreadvLlwritevInvalidFileHandle 2024-04-25T10:35:19.030 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.752+0000 7f518d909480 1 -- start start 2024-04-25T10:35:19.030 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3ad7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c003a50 con 0x55fa3ad801c0 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3adf39e0 con 0x55fa3aeb1180 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad7afe0 con 0x55fa3aea62c0 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39496/0 (socket says 172.21.15.103:39496) 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f5186bd2640 1 -- 172.21.15.103:0/3620700839 learned_addr learned my addr 172.21.15.103:0/3620700839 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f51873d3640 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3ad7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.753+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5186bd2640 1 -- 172.21.15.103:0/3620700839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.031 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5186bd2640 1 -- 172.21.15.103:0/3620700839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 msgr2=0x55fa3ad7d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3ad7d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5186bd2640 1 -- 172.21.15.103:0/3620700839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aeab960 con 0x55fa3ad801c0 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f517c000e10 tx=0x55fa3adf7b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f1e1dc767f734c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c04e040 con 0x55fa3ad801c0 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517c016440 con 0x55fa3ad801c0 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 10 client.4725 Subscribing to map 'mdsmap' 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aeaa140 con 0x55fa3ad801c0 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5175ffb640 20 client.4725 tick 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5175ffb640 20 client.4725 collect_and_send_metrics 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5175ffb640 20 client.4725 collect_and_send_global_metrics 2024-04-25T10:35:19.032 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5175ffb640 5 client.4725 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5175ffb640 20 client.4725 trim_cache size 0 max 16384 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5175ffb640 20 client.4725 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3adf4260 con 0x55fa3ad801c0 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c044040 con 0x55fa3ad801c0 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f5185bd0640 1 client.4725 handle_mds_map epoch 6 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 20 client.4725 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 10 client.4725 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 20 client.4725 mds is 0 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 10 client.4725 _open_mds_session mds.0 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ad7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae0d0e0 con 0x55fa3aea3cc0 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f518d909480 10 client.4725 waiting for session to mds.0 to open 2024-04-25T10:35:19.033 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.754+0000 7f51873d3640 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ad7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.755+0000 7f5185bd0640 10 client.4725 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.755+0000 7f51873d3640 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ad7b420 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eacd28badb293a0a server_cookie=f16c8c38d5257d41 in_seq=0 out_seq=0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae0d0e0 con 0x55fa3aea3cc0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f5185bd0640 10 client.4725 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f5185bd0640 10 client.4725 renew_caps mds.0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b010 con 0x55fa3aea3cc0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f5185bd0640 10 client.4725 connect_mds_targets for mds.0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f518d909480 10 client.4725 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f518d909480 20 client.4725 mds is 0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f518d909480 10 client.4725 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f518d909480 20 client.4725 encode_cap_releases enter (req: 0x55fa3ad7c920, mds: 0) 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f518d909480 20 client.4725 send_request set sent_stamp to 2024-04-25T10:35:18.757388+0000 2024-04-25T10:35:19.034 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f518d909480 10 client.4725 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.755192+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.755192+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae05db0 con 0x55fa3aea3cc0 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f518d909480 20 client.4725 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b010 con 0x55fa3aea3cc0 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.756+0000 7f5185bd0640 10 client.4725 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518001ce60 con 0x55fa3aea3cc0 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 insert_trace from 2024-04-25T10:35:18.757388+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 features 0xffffffffffffffff 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 update_snap_trace len 70 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 get_snap_realm 0x1 0x7f515c00b230, nref now is 1 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:19.035 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 15 client.4725 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 15 client.4725 snapc 1=[] 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 put_snap_realm 0x1 0x7f515c00b230 2 -> 1 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 hrm is_target=1 is_dentry=0 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b320) - ctime 2024-04-25T10:35:18.746548+0000 mtime 2024-04-25T10:35:18.746548+0000 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 dir hash is 2 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 12 client.4725 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 13 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 12 client.4725 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=- has_dir_layout 0x7f515c00b320) caps pAsLsXsFs 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 get_snap_realm 0x1 0x7f515c00b230, nref was 1 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 get_snap_realm 0x1 0x7f515c00b230, nref now is 2 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 15 client.4725 add_update_cap first one, opened snaprealm 0x7f515c00b230 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.036 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 add_update_cap calling signal_caps_inode 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 put_snap_realm 0x1 0x7f515c00b230 2 -> 1 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 lat 0.000405 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 _ll_get 0x7f515c00b320 0x1 -> 1 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 3 client.4725 (fh)0 is invalid 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 3 client.4725 (fh)0 is invalid 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 2 client.4725 unmount 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 unmounting: trim pass, size was 0+1 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 20 client.4725 trim_cache size 0 max 16384 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f5185bd0640 10 client.4725 unmounting: trim pass, size still 0+1 2024-04-25T10:35:19.037 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 2 client.4725 unmounting 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 _ll_drop_pins 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 _ll_put 0x7f515c00b320 0x1 1 -> 0 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 nothing to flush 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.038 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 flush_caps_sync 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 trim_cache size 0 max 16384 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 8 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 15 client.4725 remove_cap last one, closing snaprealm 0x7f515c00b230 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 20 client.4725 put_snap_realm 0x1 0x7f515c00b230 1 -> 0 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 10 client.4725 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=- has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 2 client.4725 _close_mds_session mds.0 seq 0 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3ae05db0 con 0x55fa3aea3cc0 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.757+0000 7f518d909480 2 client.4725 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ae05db0 con 0x55fa3aea3cc0 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 10 client.4725 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 5 client.4725 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 1 -- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 msgr2=0x55fa3ad7b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.039 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ad7b420 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 10 client.4725 remove_session_caps mds.0 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 10 client.4725 kick_requests_closed for mds.0 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 10 client.4725 unmounting: trim pass, size was 0+0 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 20 client.4725 trim_cache size 0 max 16384 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f5185bd0640 10 client.4725 unmounting: trim pass, size still 0+0 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 2 client.4725 unmounted. 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 client.4725 shutdown 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f517c000e10 tx=0x55fa3adf7b00 comp rx=0 tx=0).stop 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 shutdown_connections 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aea3cc0 0x55fa3ad7b420 unknown :-1 s=CLOSED pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.040 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 --2- 172.21.15.103:0/3620700839 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3ad7d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.758+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 >> 172.21.15.103:0/3620700839 conn(0x55fa3ac71ab0 msgr2=0x55fa3ae0c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.759+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 shutdown_connections 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.759+0000 7f518d909480 1 -- 172.21.15.103:0/3620700839 wait complete. 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.759+0000 7f518d909480 20 client.4725 trim_cache size 0 max 16384 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.759+0000 7f518d909480 1 -- start start 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c007ab0 con 0x55fa3aea62c0 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3adf39e0 con 0x55fa3aea3cc0 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3adf7170 con 0x55fa3ad801c0 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.041 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39504/0 (socket says 172.21.15.103:39504) 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.760+0000 7f5187bd4640 1 -- 172.21.15.103:0/3726281140 learned_addr learned my addr 172.21.15.103:0/3726281140 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f51873d3640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5187bd4640 1 -- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5187bd4640 1 -- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3ad7a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5187bd4640 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae9f330 con 0x55fa3aea62c0 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7d3a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f517800a4f0 tx=0x7f5178006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983f88fb05787144 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517805e080 con 0x55fa3aea62c0 2024-04-25T10:35:19.042 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517802a040 con 0x55fa3aea62c0 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 10 client.4728 Subscribing to map 'mdsmap' 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aea4800 con 0x55fa3aea62c0 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f51767fc640 20 client.4728 tick 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f51767fc640 20 client.4728 collect_and_send_metrics 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f51767fc640 20 client.4728 collect_and_send_global_metrics 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f51767fc640 5 client.4728 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f51767fc640 20 client.4728 trim_cache size 0 max 16384 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f51767fc640 20 client.4728 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517800add0 con 0x55fa3aea62c0 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178024b70 con 0x55fa3aea62c0 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5184bce640 1 client.4728 handle_mds_map epoch 6 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 20 client.4728 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 10 client.4728 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 20 client.4728 mds is 0 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 10 client.4728 _open_mds_session mds.0 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3aeaa240 con 0x55fa3aeb2d70 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f518d909480 10 client.4728 waiting for session to mds.0 to open 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f51873d3640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.761+0000 7f5184bce640 10 client.4728 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.762+0000 7f51873d3640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8383795c4b1d7b09 server_cookie=ba563758fb41570d in_seq=0 out_seq=0 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3aeaa240 con 0x55fa3aeb2d70 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f5184bce640 10 client.4728 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f5184bce640 10 client.4728 renew_caps mds.0 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b010 con 0x55fa3aeb2d70 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f5184bce640 10 client.4728 connect_mds_targets for mds.0 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f518d909480 10 client.4728 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f518d909480 20 client.4728 mds is 0 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f518d909480 10 client.4728 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f518d909480 20 client.4728 encode_cap_releases enter (req: 0x55fa3ae05e70, mds: 0) 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f518d909480 20 client.4728 send_request set sent_stamp to 2024-04-25T10:35:18.764275+0000 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f518d909480 10 client.4728 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.762138+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.762138+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb3180 con 0x55fa3aeb2d70 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f518d909480 20 client.4728 awaiting reply|forward|kick on 0x7ffc16ba7a80 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b010 con 0x55fa3aeb2d70 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.763+0000 7f5184bce640 10 client.4728 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518001ce60 con 0x55fa3aeb2d70 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 insert_trace from 2024-04-25T10:35:18.764275+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 features 0xffffffffffffffff 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 update_snap_trace len 70 2024-04-25T10:35:19.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref now is 1 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 15 client.4728 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 15 client.4728 snapc 1=[] 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 put_snap_realm 0x1 0x7f515c00b230 2 -> 1 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 hrm is_target=1 is_dentry=0 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b320) - ctime 2024-04-25T10:35:18.746548+0000 mtime 2024-04-25T10:35:18.746548+0000 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 dir hash is 2 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 12 client.4728 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 13 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 12 client.4728 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=- has_dir_layout 0x7f515c00b320) caps pAsLsXsFs 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref was 1 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref now is 2 2024-04-25T10:35:19.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 15 client.4728 add_update_cap first one, opened snaprealm 0x7f515c00b230 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 add_update_cap calling signal_caps_inode 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 put_snap_realm 0x1 0x7f515c00b230 2 -> 1 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 handle_client_reply signalling caller 0x7ffc16ba7a80 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 lat 0.000477 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 _ll_get 0x7f515c00b320 0x1 -> 1 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 8 client.4728 _ll_create 0x1.head test_llreadvllwritevinvalidfhfile43224 0666 578, uid 0, gid 0 2024-04-25T10:35:19.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 _do_lookup on #0x1/test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 choose_target_mds inode dir hash is 2 on test_llreadvllwritevinvalidfhfile43224 => 4187941600 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 choose_target_mds 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) is_hash=1 hash=4187941600 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 mds is 0 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 encode_cap_releases enter (req: 0x55fa3ad38280, mds: 0) 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 send_request set sent_stamp to 2024-04-25T10:35:18.764813+0000 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 send_request client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:18.764783+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:18.764783+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad38640 con 0x55fa3aeb2d70 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 awaiting reply|forward|kick on 0x7ffc16ba7870 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f5180000bc0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 insert_trace from 2024-04-25T10:35:18.764813+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 10 client.4728 insert_trace -- no trace 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 handle_client_reply signalling caller 0x7ffc16ba7870 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 lat 0.000248 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 _do_lookup res is -2 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 _lookup 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) test_llreadvllwritevinvalidfhfile43224 = -2 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 may_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 _getattr mask As issued=1 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 3 client.4728 may_create 0x7f515c00b320 = 0 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 8 client.4728 _create(0x1 test_llreadvllwritevinvalidfhfile43224, 0666) 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) name test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:19.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 15 open_dir 0x55fa3aea40d0 on 0x7f515c00b320 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 15 client.4728 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 'test_llreadvllwritevinvalidfhfile43224' dn 0x1.head["test_llreadvllwritevinvalidfhfile43224"] (new dn) 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 choose_target_mds inode dir hash is 2 on test_llreadvllwritevinvalidfhfile43224 => 4187941600 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) is_hash=1 hash=4187941600 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 mds is 0 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 encode_cap_releases enter (req: 0x55fa3ad38640, mds: 0) 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 encode_dentry_release enter(dn:0x7f515c00af20) 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320), req:0x55fa3ad38640 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 send_request set sent_stamp to 2024-04-25T10:35:18.765144+0000 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 10 client.4728 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:18.765109+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:18.765109+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf4650 con 0x55fa3aeb2d70 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f518d909480 20 client.4728 awaiting reply|forward|kick on 0x7ffc16ba78d0 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.764+0000 7f5184bce640 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 859+0+0 (crc 0 0 0) 0x7f5180045be0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 insert_trace from 2024-04-25T10:35:18.765144+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 features 0xffffffffffffffff 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 update_snap_trace len 70 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref was 1 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref now is 2 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 hrm is_target=1 is_dentry=1 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 update_inode_file_time 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) - ctime 2024-04-25T10:35:18.765109+0000 mtime 2024-04-25T10:35:18.765109+0000 2024-04-25T10:35:19.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 12 client.4728 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 12 client.4728 add_update_inode adding 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=- objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref was 2 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref now is 3 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 15 client.4728 add_update_cap first one, opened snaprealm 0x7f515c00b230 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 add_update_cap calling signal_caps_inode 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 12 client.4728 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) caps pAsLsXs 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.746548+0000 ctime=2024-04-25T10:35:18.746548+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) pAsLsXs ctime 2024-04-25T10:35:18.765109+0000 mtime 2024-04-25T10:35:18.765109+0000 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 dir hash is 2 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 12 client.4728 add_update_inode client inode change_attr: 13 , mds inodestat change_attr: 14 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:19.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 12 client.4728 insert_dentry_inode 'test_llreadvllwritevinvalidfhfile43224' vino 0x10000000007.head in dir 0x1.head dn 0x7f515c00af20 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 15 client.4728 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) 'test_llreadvllwritevinvalidfhfile43224' to inode 0x7f515c00b900 dn 0x1.head["test_llreadvllwritevinvalidfhfile43224"] (old dn) 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 link inode 0x7f515c00b900 parents now 0x1.head["test_llreadvllwritevinvalidfhfile43224"] 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 15 client.4728 update_dentry_lease 0x1.head["test_llreadvllwritevinvalidfhfile43224"] lease(mask 7 dur 30000) from 2024-04-25T10:35:18.765144+0000 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 got dentry lease on test_llreadvllwritevinvalidfhfile43224 dur 30000ms ttl 2024-04-25T10:35:48.765144+0000 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 put_snap_realm 0x1 0x7f515c00b230 3 -> 2 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 handle_client_reply signalling caller 0x7ffc16ba78d0 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 delegated_inos: [] 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 make_request created ino 0x10000000007 2024-04-25T10:35:19.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 make_request target is 0x10000000007.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 lat 0.002820 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000007.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000007.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 _create_fh 0x10000000007 mode 3 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 trim_cache size 1 max 16384 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 8 client.4728 create(#0x1/test_llreadvllwritevinvalidfhfile43224, 0100666 layout 0 0 0) = 0 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 _ll_create created = 1 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 8 client.4728 _ll_create 0x1.head test_llreadvllwritevinvalidfhfile43224 0666 578 = 0 (0x55fa3ad7efb0 10000000007) 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 _ll_get 0x7f515c00b900 0x10000000007 -> 1 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 fill_statx on 0x10000000007 snap/devhead mode 0100666 mtime 2024-04-25T10:35:18.765109+0000 ctime 2024-04-25T10:35:18.765109+0000 change_attr 0 2024-04-25T10:35:19.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 3 client.4728 ll_release (fh)0x55fa3ad7efb0 0x10000000007 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 8 client.4728 _release_fh 0x55fa3ad7efb0 mode 3 on 0x10000000007.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 _flush 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 nothing to flush 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 check_caps on 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 delaying cap release 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 cap_delay_requeue on 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 _release_fh 0x55fa3ad7efb0 on inode 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) no async_err state 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 3 client.4728 ll_unlink 0x1.head test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 may_delete 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320); ; name test_llreadvllwritevinvalidfhfile43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 _getattr mask As issued=1 2024-04-25T10:35:19.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 3 client.4728 may_delete 0x7f515c00b320 = 0 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 8 client.4728 _unlink(0x1 test_llreadvllwritevinvalidfhfile43224 uid 0 gid 0) 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 get_or_create 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) name test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 _lookup have 0x1.head["test_llreadvllwritevinvalidfhfile43224"] from mds.0 ttl 2024-04-25T10:35:48.765144+0000 seq 2 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 _lookup 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) test_llreadvllwritevinvalidfhfile43224 = 0x10000000007.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 choose_target_mds inode dir hash is 2 on test_llreadvllwritevinvalidfhfile43224 => 4187941600 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 choose_target_mds 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) is_hash=1 hash=4187941600 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 choose_target_mds from dirfragtree hash 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 mds is 0 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 send_request rebuilding request 4 for mds.0 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 encode_cap_releases enter (req: 0x55fa3adf4650, mds: 0) 2024-04-25T10:35:19.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 encode_inode_release enter(in:0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900), req:0x55fa3adf4650 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 encode_dentry_release enter(dn:0x7f515c00af20) 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320), req:0x55fa3adf4650 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 send_request set sent_stamp to 2024-04-25T10:35:18.768094+0000 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 10 client.4728 send_request client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:18.768072+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevinvalidfhfile43224 2024-04-25T10:35:18.768072+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf49e0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f518d909480 20 client.4728 awaiting reply|forward|kick on 0x7ffc16ba7aa0 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(revoke ino 0x10000000007 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.765109+0000 ctime 2024-04-25T10:35:18.765109+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f518000a040 con 0x55fa3aeb2d70 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 5 client.4728 set_cap_epoch_barrier epoch = 20 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 mds.0 seq now 1 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 5 client.4728 handle_cap_grant on in 0x10000000007 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 update_inode_file_time 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:18.765109+0000 mtime 2024-04-25T10:35:18.765109+0000 2024-04-25T10:35:19.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 revocation of AxXx 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 check_caps on 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) wanted - used - issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 completed revocation of AxXx 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 send_cap 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile43224"] 0x7f515c00b900) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsxFsxcrwb revoking AxXx dropping Fxcrwb 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 15 client.4728 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000007 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.765109+0000 ctime 2024-04-25T10:35:18.765109+0000 change_attr 0) -- 0x7f515c00bee0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.767+0000 7f5184bce640 10 client.4728 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:4 = 0 (0) Success unsafe) ==== 507+0+0 (crc 0 0 0) 0x7f518005ec60 con 0x55fa3aeb2d70 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 handle_client_reply got a reply. Safe:0 tid 4 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 10 client.4728 insert_trace from 2024-04-25T10:35:18.768094+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 10 client.4728 features 0xffffffffffffffff 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 10 client.4728 update_snap_trace len 70 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref was 2 2024-04-25T10:35:19.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 get_snap_realm 0x1 0x7f515c00b230, nref now is 3 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 10 client.4728 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 10 client.4728 hrm is_target=0 is_dentry=1 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 12 client.4728 add_update_inode had 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) caps pAsLsXs 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 10 client.4728 update_inode_file_time 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) pAsLsXs ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.765109+0000 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 dir hash is 2 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 12 client.4728 add_update_inode client inode change_attr: 14 , mds inodestat change_attr: 15 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 10 client.4728 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 15 client.4728 unlink dir 0x7f515c00b320 'test_llreadvllwritevinvalidfhfile43224' dn 0x7f515c00af20 inode 0x7f515c00b900 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 unlink inode 0x7f515c00b900 parents now 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 15 client.4728 update_dentry_lease 0x1.head["test_llreadvllwritevinvalidfhfile43224"] lease(mask 3 dur 30000) from 2024-04-25T10:35:18.768094+0000 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 10 client.4728 got dentry lease on test_llreadvllwritevinvalidfhfile43224 dur 30000ms ttl 2024-04-25T10:35:48.768094+0000 2024-04-25T10:35:19.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 put_snap_realm 0x1 0x7f515c00b230 3 -> 2 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 handle_client_reply signalling caller 0x7ffc16ba7aa0 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f5184bce640 20 client.4728 handle_client_reply awaiting kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 20 client.4728 sendrecv kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 20 client.4728 lat 0.001683 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 20 client.4728 trim_cache size 1 max 16384 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 8 client.4728 unlink(#0x1/test_llreadvllwritevinvalidfhfile43224) = 0 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 3 client.4728 (fh)0x55fa3ad7efb0 is invalid 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 3 client.4728 (fh)0x55fa3ad7efb0 is invalid 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 2 client.4728 unmount 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 2 client.4728 unmounting 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3ae0d0e0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.769+0000 7f518d909480 10 client.4728 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(grant ino 0x10000000007 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.765109+0000 ctime 2024-04-25T10:35:18.768072+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f515c00bee0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 mds.0 seq now 2 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 5 client.4728 handle_cap_grant on in 0x10000000007 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 update_inode_file_time 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.765109+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) pAsXsFs ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.765109+0000 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 max_size 4194304 -> 0 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 grant, new caps are LsFxcrwb 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 5 client.4728 _try_to_trim_inode in 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 unmounting: trim pass, size was 1+2 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 20 client.4728 trim_cache size 1 max 16384 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 unmounting: trim pass, size still 1+2 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_reply(???:4 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f518000a3a0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 20 client.4728 handle_client_reply got a reply. Safe:1 tid 4 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 insert_trace from 2024-04-25T10:35:18.768094+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 unmounting: trim pass, size was 1+2 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 20 client.4728 trim_cache size 1 max 16384 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 15 client.4728 trim_dentry unlinking dn test_llreadvllwritevinvalidfhfile43224 in dir 0x1 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 15 client.4728 unlink dir 0x7f515c00b320 'test_llreadvllwritevinvalidfhfile43224' dn 0x7f515c00af20 inode 0 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 15 client.4728 unlink removing 'test_llreadvllwritevinvalidfhfile43224' dn 0x7f515c00af20 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 15 client.4728 close_dir dir 0x55fa3aea40d0 on 0x7f515c00b320 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _ll_drop_pins 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 _ll_put 0x7f515c00b900 0x10000000007 1 -> 0 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 _ll_put 0x7f515c00b320 0x1 2 -> 0 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 _release 0x10000000007.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _invalidate_inode_cache 0x10000000007.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _flush 0x10000000007.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 nothing to flush 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 _release 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _flush 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 nothing to flush 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x10000000007.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 1 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 flush_caps_sync 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 trim_cache size 0 max 16384 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) n = 12 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 15 client.4728 remove_cap last one, closing snaprealm 0x7f515c00b230 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_snap_realm 0x1 0x7f515c00b230 2 -> 1 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_caps(grant ino 0x10000000007 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:18.765109+0000 ctime 2024-04-25T10:35:18.768072+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f518005e040 con 0x55fa3aeb2d70 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _put_inode on 0x10000000007.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) n = 15 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 remove_cap mds.0 on 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 15 client.4728 remove_cap last one, closing snaprealm 0x7f515c00b230 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 20 client.4728 put_snap_realm 0x1 0x7f515c00b230 1 -> 0 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 10 client.4728 _put_inode deleting 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-04-25T10:35:18.765109+0000 mtime=2024-04-25T10:35:18.765109+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=1 caps=- objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00b900) 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 2 client.4728 _close_mds_session mds.0 seq 2 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 2) -- 0x55fa3adf49e0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f518d909480 2 client.4728 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 mds.0 seq now 3 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 3) -- 0x7f515c00b010 con 0x55fa3aeb2d70 2024-04-25T10:35:19.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 5 client.4728 handle_caps don't have vino 0x10000000007.head op 0, immediately releasing 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_cap_release(3) -- 0x55fa3ae061f0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 unmounting: trim pass, size was 0+0 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 20 client.4728 trim_cache size 0 max 16384 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.771+0000 7f5184bce640 10 client.4728 unmounting: trim pass, size still 0+0 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adf49e0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 10 client.4728 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 5 client.4728 _closed_mds_session mds.0 seq 3 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 1 -- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3aea1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 10 client.4728 remove_session_caps mds.0 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 10 client.4728 kick_requests_closed for mds.0 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 10 client.4728 unmounting: trim pass, size was 0+0 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 20 client.4728 trim_cache size 0 max 16384 2024-04-25T10:35:19.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f5184bce640 10 client.4728 unmounting: trim pass, size still 0+0 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 2 client.4728 unmounted. 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 client.4728 shutdown 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7d3a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f517800a4f0 tx=0x7f5178006000 comp rx=0 tx=0).stop 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 shutdown_connections 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 unknown :-1 s=CLOSED pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7d3a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 --2- 172.21.15.103:0/3726281140 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 >> 172.21.15.103:0/3726281140 conn(0x55fa3ac71ab0 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 shutdown_connections 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 1 -- 172.21.15.103:0/3726281140 wait complete. 2024-04-25T10:35:19.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.773+0000 7f518d909480 20 client.4728 trim_cache size 0 max 16384 2024-04-25T10:35:19.068 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.LlreadvLlwritevInvalidFileHandle (22 ms) 2024-04-25T10:35:19.068 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.CheckDummyOP 2024-04-25T10:35:19.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.774+0000 7f518d909480 1 -- start start 2024-04-25T10:35:19.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:19.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aeb0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c003980 con 0x55fa3ad801c0 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad7a000 con 0x55fa3aea3cc0 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeab810 con 0x55fa3aea62c0 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39506/0 (socket says 172.21.15.103:39506) 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f51873d3640 1 -- 172.21.15.103:0/2535248035 learned_addr learned my addr 172.21.15.103:0/2535248035 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aeb0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f5187bd4640 1 -- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3ad7a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f5187bd4640 1 -- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.076 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f5187bd4640 1 -- 172.21.15.103:0/2535248035 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3adff2d0 con 0x55fa3aea62c0 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f51873d3640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.775+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aeb0870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5178012a10 tx=0x7f5178024f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cea1f9589d8fdcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.132:3301/0 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517805e040 con 0x55fa3aea62c0 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mon.2 v2:172.21.15.132:3301/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f517802a040 con 0x55fa3aea62c0 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 10 client.4532 Subscribing to map 'mdsmap' 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ad7afa0 con 0x55fa3aea62c0 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5175ffb640 20 client.4532 tick 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5175ffb640 20 client.4532 collect_and_send_metrics 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5175ffb640 20 client.4532 collect_and_send_global_metrics 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5175ffb640 5 client.4532 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:19.077 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5175ffb640 20 client.4532 trim_cache size 0 max 16384 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5175ffb640 20 client.4532 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mon.2 v2:172.21.15.132:3301/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517800add0 con 0x55fa3aea62c0 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178024d80 con 0x55fa3aea62c0 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5185bd0640 1 client.4532 handle_mds_map epoch 6 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 20 client.4532 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 10 client.4532 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 20 client.4532 mds is 0 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 10 client.4532 _open_mds_session mds.0 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae0c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3aeaa240 con 0x55fa3aeb2d70 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f518d909480 10 client.4532 waiting for session to mds.0 to open 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f51873d3640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae0c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.776+0000 7f5185bd0640 10 client.4532 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:19.078 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.777+0000 7f51873d3640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae0c710 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b1af3172031b5f0 server_cookie=a08e7639cfb04b00 in_seq=0 out_seq=0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3aeaa240 con 0x55fa3aeb2d70 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 renew_caps mds.0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00adf0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 connect_mds_targets for mds.0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f518d909480 10 client.4532 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f518d909480 20 client.4532 mds is 0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f518d909480 10 client.4532 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f518d909480 20 client.4532 encode_cap_releases enter (req: 0x55fa3ae04d00, mds: 0) 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f518d909480 20 client.4532 send_request set sent_stamp to 2024-04-25T10:35:18.779148+0000 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f518d909480 10 client.4532 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.776984+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.776984+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad7e3b0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f518d909480 20 client.4532 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00adf0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:19.079 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518000b7b0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 20 client.4532 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 insert_trace from 2024-04-25T10:35:18.779148+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 features 0xffffffffffffffff 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 update_snap_trace len 70 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 20 client.4532 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 20 client.4532 get_snap_realm 0x1 0x7f515c00b010, nref now is 1 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.778+0000 7f5185bd0640 10 client.4532 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 15 client.4532 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 15 client.4532 snapc 1=[] 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 put_snap_realm 0x1 0x7f515c00b010 2 -> 1 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 hrm is_target=1 is_dentry=0 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b320) - ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.768072+0000 2024-04-25T10:35:19.080 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 dir hash is 2 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 12 client.4532 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 12 client.4532 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) caps pAsLsXsFs 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 get_snap_realm 0x1 0x7f515c00b010, nref was 1 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 get_snap_realm 0x1 0x7f515c00b010, nref now is 2 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 15 client.4532 add_update_cap first one, opened snaprealm 0x7f515c00b010 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 add_update_cap calling signal_caps_inode 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 put_snap_realm 0x1 0x7f515c00b010 2 -> 1 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:19.081 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 lat 0.000393 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 _ll_get 0x7f515c00b320 0x1 -> 1 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 mds is 0 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 1 client.4532 Warning -- unable to construct a filepath! No path, inode, or dentry given! 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 encode_cap_releases enter (req: 0x55fa3ad7e3b0, mds: 0) 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 send_request set sent_stamp to 2024-04-25T10:35:18.779567+0000 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 send_request client_request(unknown.0:2 dummy 2024-04-25T10:35:18.779560+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 dummy 2024-04-25T10:35:18.779560+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad7e700 con 0x55fa3aeb2d70 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 awaiting reply|forward|kick on 0x7ffc16ba7e30 2024-04-25T10:35:19.082 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -95 (95) Operation not supported) ==== 27+0+0 (crc 0 0 0) 0x7f51800627a0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 insert_trace from 2024-04-25T10:35:18.779567+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 insert_trace -- no trace 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 handle_client_reply signalling caller 0x7ffc16ba7e30 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 handle_client_reply awaiting kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 sendrecv kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 lat 0.000140 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 check_dummy_op result=-95 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 2 client.4532 unmount 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 unmounting: trim pass, size was 0+1 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 20 client.4532 trim_cache size 0 max 16384 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f5185bd0640 10 client.4532 unmounting: trim pass, size still 0+1 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 2 client.4532 unmounting 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.083 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 _ll_drop_pins 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 _ll_put 0x7f515c00b320 0x1 1 -> 0 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 nothing to flush 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 flush_caps_sync 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:19.084 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 trim_cache size 0 max 16384 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 8 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 15 client.4532 remove_cap last one, closing snaprealm 0x7f515c00b010 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 20 client.4532 put_snap_realm 0x1 0x7f515c00b010 1 -> 0 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 10 client.4532 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 2 client.4532 _close_mds_session mds.0 seq 0 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3aea4fa0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.779+0000 7f518d909480 2 client.4532 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aea4fa0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 10 client.4532 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 5 client.4532 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 1 -- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ae0c710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae0c710 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 10 client.4532 remove_session_caps mds.0 2024-04-25T10:35:19.085 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 10 client.4532 kick_requests_closed for mds.0 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 10 client.4532 unmounting: trim pass, size was 0+0 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 20 client.4532 trim_cache size 0 max 16384 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f5185bd0640 10 client.4532 unmounting: trim pass, size still 0+0 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 2 client.4532 unmounted. 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 client.4532 shutdown 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 msgr2=0x55fa3aeb0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aeb0870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5178012a10 tx=0x7f5178024f90 comp rx=0 tx=0).stop 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 shutdown_connections 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae0c710 unknown :-1 s=CLOSED pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aeb0870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 --2- 172.21.15.103:0/2535248035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 >> 172.21.15.103:0/2535248035 conn(0x55fa3ac71ab0 msgr2=0x55fa3ae03b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:19.086 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 shutdown_connections 2024-04-25T10:35:19.087 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 1 -- 172.21.15.103:0/2535248035 wait complete. 2024-04-25T10:35:19.087 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.780+0000 7f518d909480 20 client.4532 trim_cache size 0 max 16384 2024-04-25T10:35:19.087 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.CheckDummyOP (7 ms) 2024-04-25T10:35:19.087 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.CheckUnknownSessionOp 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.781+0000 7f518d909480 1 -- start start 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c006b20 con 0x55fa3aea62c0 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3aeba470 con 0x55fa3aea3cc0 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad7e3b0 con 0x55fa3ad801c0 2024-04-25T10:35:19.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39522/0 (socket says 172.21.15.103:39522) 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f5187bd4640 1 -- 172.21.15.103:0/2236094452 learned_addr learned my addr 172.21.15.103:0/2236094452 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.782+0000 7f51873d3640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5187bd4640 1 -- 172.21.15.103:0/2236094452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5187bd4640 1 -- 172.21.15.103:0/2236094452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3ad7a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5187bd4640 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae05fd0 con 0x55fa3aea62c0 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f517800c1d0 tx=0x7f517801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba41f15995bb9f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178055040 con 0x55fa3aea62c0 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f5178051b60 con 0x55fa3aea62c0 2024-04-25T10:35:19.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 10 client.4734 Subscribing to map 'mdsmap' 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aeb1350 con 0x55fa3aea62c0 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f51767fc640 20 client.4734 tick 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f51767fc640 20 client.4734 collect_and_send_metrics 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f51767fc640 20 client.4734 collect_and_send_global_metrics 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f51767fc640 5 client.4734 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f51767fc640 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f51767fc640 20 client.4734 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178051d60 con 0x55fa3aea62c0 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178024440 con 0x55fa3aea62c0 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f5184bce640 1 client.4734 handle_mds_map epoch 6 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 20 client.4734 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 10 client.4734 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 20 client.4734 mds is 0 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 10 client.4734 _open_mds_session mds.0 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad38280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ad7aed0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f518d909480 10 client.4734 waiting for session to mds.0 to open 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.783+0000 7f51873d3640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad38280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.784+0000 7f5184bce640 10 client.4734 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.784+0000 7f51873d3640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad38280 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ab1ea2d225b614 server_cookie=df7b49463025b79b in_seq=0 out_seq=0 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ad7aed0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 renew_caps mds.0 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c003a10 con 0x55fa3aeb2d70 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 connect_mds_targets for mds.0 2024-04-25T10:35:19.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 10 client.4734 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 20 client.4734 mds is 0 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 10 client.4734 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 20 client.4734 encode_cap_releases enter (req: 0x55fa3aeb0710, mds: 0) 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 20 client.4734 send_request set sent_stamp to 2024-04-25T10:35:18.786858+0000 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 10 client.4734 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.784164+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:18.784164+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aeb0a80 con 0x55fa3aeb2d70 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 20 client.4734 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c003a10 con 0x55fa3aeb2d70 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180005ac0 con 0x55fa3aeb2d70 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 insert_trace from 2024-04-25T10:35:18.786858+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 features 0xffffffffffffffff 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 update_snap_trace len 70 2024-04-25T10:35:19.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 get_snap_realm 0x1 0x7f515c003c30, nref now is 1 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 15 client.4734 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 15 client.4734 snapc 1=[] 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 put_snap_realm 0x1 0x7f515c003c30 2 -> 1 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 hrm is_target=1 is_dentry=0 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b320) - ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.768072+0000 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 dir hash is 2 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 12 client.4734 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 12 client.4734 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) caps pAsLsXsFs 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 get_snap_realm 0x1 0x7f515c003c30, nref was 1 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 get_snap_realm 0x1 0x7f515c003c30, nref now is 2 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 15 client.4734 add_update_cap first one, opened snaprealm 0x7f515c003c30 2024-04-25T10:35:19.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 add_update_cap calling signal_caps_inode 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 put_snap_realm 0x1 0x7f515c003c30 2 -> 1 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 20 client.4734 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 20 client.4734 lat 0.000386 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 20 client.4734 _ll_get 0x7f515c00b320 0x1 -> 1 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(???) -- 0x55fa3ae03b20 con 0x55fa3aeb2d70 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f518d909480 10 send_unknown_session_op result=0 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.099 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f838c20a640 -1 mds.0.server Server received unknown message 22, closing session and blocklisting the client 4734 2024-04-25T10:35:19.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_session(reject) ==== 28+0+0 (crc 0 0 0) 0x55fa3ae03b20 con 0x55fa3aeb2d70 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 handle_client_session client_session(reject) from mds.0 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 -1 client.4734 mds.0 rejected us (unknown error) 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 5 client.4734 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ad38280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad38280 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 remove_session_caps mds.0 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 15 client.4734 remove_cap last one, closing snaprealm 0x7f515c003c30 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 put_snap_realm 0x1 0x7f515c003c30 1 -> 0 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 remove_session_caps calling signal_caps_inode 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:19.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:18.786+0000 7f5184bce640 10 client.4734 kick_requests_closed for mds.0 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 20 client.4734 tick 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 10 client.4734 renew_caps() 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 15 client.4734 renew_caps requesting from mds.0 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 10 client.4734 renew_caps mds.0 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 2) -- 0x7f5160000d20 con 0x55fa3aeb2d70 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 20 client.4734 collect_and_send_metrics 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 20 client.4734 collect_and_send_global_metrics 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 5 client.4734 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 10 client.4734 _put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) n = 3 2024-04-25T10:35:19.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:19.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:19.783+0000 7f51767fc640 20 client.4734 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:20.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:20.783+0000 7f51767fc640 20 client.4734 tick 2024-04-25T10:35:20.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:20.783+0000 7f51767fc640 20 client.4734 collect_and_send_metrics 2024-04-25T10:35:20.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:20.783+0000 7f51767fc640 20 client.4734 collect_and_send_global_metrics 2024-04-25T10:35:20.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:20.783+0000 7f51767fc640 5 client.4734 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-04-25T10:35:20.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:20.783+0000 7f51767fc640 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:20.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:20.783+0000 7f51767fc640 20 client.4734 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:21.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:21.784+0000 7f51767fc640 20 client.4734 tick 2024-04-25T10:35:21.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:21.784+0000 7f51767fc640 20 client.4734 collect_and_send_metrics 2024-04-25T10:35:21.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:21.784+0000 7f51767fc640 20 client.4734 collect_and_send_global_metrics 2024-04-25T10:35:21.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:21.784+0000 7f51767fc640 5 client.4734 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-04-25T10:35:21.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:21.784+0000 7f51767fc640 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:21.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:21.784+0000 7f51767fc640 20 client.4734 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:22.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:22.784+0000 7f51767fc640 20 client.4734 tick 2024-04-25T10:35:22.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:22.784+0000 7f51767fc640 20 client.4734 collect_and_send_metrics 2024-04-25T10:35:22.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:22.784+0000 7f51767fc640 20 client.4734 collect_and_send_global_metrics 2024-04-25T10:35:22.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:22.784+0000 7f51767fc640 5 client.4734 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-04-25T10:35:22.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:22.784+0000 7f51767fc640 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:22.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:22.784+0000 7f51767fc640 20 client.4734 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.785 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.784+0000 7f51767fc640 20 client.4734 tick 2024-04-25T10:35:23.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.784+0000 7f51767fc640 20 client.4734 collect_and_send_metrics 2024-04-25T10:35:23.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.784+0000 7f51767fc640 20 client.4734 collect_and_send_global_metrics 2024-04-25T10:35:23.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.784+0000 7f51767fc640 5 client.4734 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-04-25T10:35:23.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.784+0000 7f51767fc640 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:23.786 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.784+0000 7f51767fc640 20 client.4734 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.786+0000 7f518d909480 20 check_client_blocklisted: waiting for latest osdmap 2024-04-25T10:35:23.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.786+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x55fa3ae03d40 con 0x55fa3aea62c0 2024-04-25T10:35:23.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mon.0 v2:172.21.15.103:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5178051d60 con 0x55fa3aea62c0 2024-04-25T10:35:23.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f51883d5640 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=23}) -- 0x7f51640034c0 con 0x55fa3aea62c0 2024-04-25T10:35:23.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 <== mon.0 v2:172.21.15.103:3300/0 6 ==== osd_map(23..23 src has 1..23) ==== 331+0+0 (secure 0 0 0) 0x7f5178024620 con 0x55fa3aea62c0 2024-04-25T10:35:23.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 20 check_client_blocklisted: got latest osdmap: system:0 2024-04-25T10:35:23.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 2 client.4734 unmount 2024-04-25T10:35:23.790 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 -1 client.4734 I was blocklisted at osd epoch 23 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 5 client.4734 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ad38280 unknown :-1 s=STATE_CLOSED l=0).mark_down 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad38280 unknown :-1 s=CLOSED pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 10 client.4734 remove_session_caps mds.0 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 10 client.4734 kick_requests_closed for mds.0 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 1 -- 172.21.15.103:0/2236094452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=24}) -- 0x7f515c004650 con 0x55fa3aea62c0 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 10 client.4734 unmounting: trim pass, size was 0+1 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f5184bce640 10 client.4734 unmounting: trim pass, size still 0+1 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 2 client.4734 unmounting (blocklisted) 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=4 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=4 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 10 client.4734 _ll_drop_pins 2024-04-25T10:35:23.791 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 20 client.4734 _ll_put 0x7f515c00b320 0x1 1 -> 0 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) n = 1 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 10 client.4734 _put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) n = 5 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 10 client.4734 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b320) 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 2 client.4734 unmounted. 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 client.4734 shutdown 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ae0c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f517800c1d0 tx=0x7f517801d000 comp rx=0 tx=0).stop 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 shutdown_connections 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad38280 unknown :-1 s=CLOSED pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.792 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 --2- 172.21.15.103:0/2236094452 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.787+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 >> 172.21.15.103:0/2236094452 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.788+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 shutdown_connections 2024-04-25T10:35:23.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.788+0000 7f518d909480 1 -- 172.21.15.103:0/2236094452 wait complete. 2024-04-25T10:35:23.793 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.788+0000 7f518d909480 20 client.4734 trim_cache size 0 max 16384 2024-04-25T10:35:23.793 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.CheckUnknownSessionOp (5007 ms) 2024-04-25T10:35:23.793 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.CheckZeroReclaimFlag 2024-04-25T10:35:23.799 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.788+0000 7f518d909480 1 -- start start 2024-04-25T10:35:23.799 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.789+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:23.799 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c00afe0 con 0x55fa3aea62c0 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae02c30 con 0x55fa3aea3cc0 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeab890 con 0x55fa3ad801c0 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50514/0 (socket says 172.21.15.103:50514) 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 -- 172.21.15.103:0/2900768550 learned_addr learned my addr 172.21.15.103:0/2900768550 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f51873d3640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 -- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 -- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3ad7a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.800 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 -- 172.21.15.103:0/2900768550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3adfff60 con 0x55fa3aea62c0 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5178002230 tx=0x7f5178026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e21ac89d11a4b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.790+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517805e030 con 0x55fa3aea62c0 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517802a070 con 0x55fa3aea62c0 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 10 client.4737 Subscribing to map 'mdsmap' 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae04e10 con 0x55fa3aea62c0 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5175ffb640 20 client.4737 tick 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5175ffb640 20 client.4737 collect_and_send_metrics 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5175ffb640 20 client.4737 collect_and_send_global_metrics 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5175ffb640 5 client.4737 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5175ffb640 20 client.4737 trim_cache size 0 max 16384 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5175ffb640 20 client.4737 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178024650 con 0x55fa3aea62c0 2024-04-25T10:35:23.801 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178024800 con 0x55fa3aea62c0 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f5185bd0640 1 client.4737 handle_mds_map epoch 6 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 20 client.4737 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 10 client.4737 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 20 client.4737 mds is 0 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 10 client.4737 _open_mds_session mds.0 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae05db0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f518d909480 10 client.4737 waiting for session to mds.0 to open 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.791+0000 7f51873d3640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.792+0000 7f5185bd0640 10 client.4737 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.792+0000 7f51873d3640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98917c840cc7f232 server_cookie=e29581fd80c00655 in_seq=0 out_seq=0 2024-04-25T10:35:23.802 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae05db0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f5185bd0640 10 client.4737 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f5185bd0640 10 client.4737 renew_caps mds.0 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f5185bd0640 10 client.4737 connect_mds_targets for mds.0 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f518d909480 10 client.4737 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f518d909480 20 client.4737 mds is 0 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f518d909480 10 client.4737 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f518d909480 20 client.4737 encode_cap_releases enter (req: 0x55fa3ae03ee0, mds: 0) 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f518d909480 20 client.4737 send_request set sent_stamp to 2024-04-25T10:35:23.795365+0000 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f518d909480 10 client.4737 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.792026+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.792026+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9f0d0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f518d909480 20 client.4737 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.794+0000 7f5185bd0640 10 client.4737 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:23.803 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f518001ce60 con 0x55fa3aeb2d70 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 insert_trace from 2024-04-25T10:35:23.795365+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 features 0xffffffffffffffff 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 update_snap_trace len 70 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 get_snap_realm 0x1 0x7f515c00b540, nref now is 1 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 15 client.4737 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 15 client.4737 snapc 1=[] 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 put_snap_realm 0x1 0x7f515c00b540 2 -> 1 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 hrm is_target=1 is_dentry=0 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b630) - ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.768072+0000 2024-04-25T10:35:23.804 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 dir hash is 2 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 12 client.4737 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 12 client.4737 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b630) caps pAsLsXsFs 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 get_snap_realm 0x1 0x7f515c00b540, nref was 1 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 get_snap_realm 0x1 0x7f515c00b540, nref now is 2 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 15 client.4737 add_update_cap first one, opened snaprealm 0x7f515c00b540 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 put_snap_realm 0x1 0x7f515c00b540 2 -> 1 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 lat 0.000534 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 _ll_get 0x7f515c00b630 0x1 -> 1 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.805 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_reclaim(unknownreclaimflag:a8d8 flags 0x0) -- 0x55fa3ae04370 con 0x55fa3aeb2d70 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reclaim_reply(-22 e 0) ==== 13+0+0 (crc 0 0 0) 0x7f5180093040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f5185bd0640 10 client.4737 handle_client_reclaim_reply client_reclaim_reply(-22 e 0) from mds.0 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 2 client.4737 unmount 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 2 client.4737 unmounting 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 _ll_drop_pins 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 _ll_put 0x7f515c00b630 0x1 1 -> 0 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.806 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 nothing to flush 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 flush_caps_sync 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 trim_cache size 0 max 16384 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 8 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 15 client.4737 remove_cap last one, closing snaprealm 0x7f515c00b540 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 20 client.4737 put_snap_realm 0x1 0x7f515c00b540 1 -> 0 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 10 client.4737 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 2 client.4737 _close_mds_session mds.0 seq 0 2024-04-25T10:35:23.807 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3ae9f280 con 0x55fa3aeb2d70 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.795+0000 7f518d909480 2 client.4737 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ae9f280 con 0x55fa3aeb2d70 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 10 client.4737 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 5 client.4737 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 1 -- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ae9eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 10 client.4737 remove_session_caps mds.0 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 10 client.4737 kick_requests_closed for mds.0 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 10 client.4737 unmounting: trim pass, size was 0+0 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 20 client.4737 trim_cache size 0 max 16384 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f5185bd0640 10 client.4737 unmounting: trim pass, size still 0+0 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 2 client.4737 unmounted. 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 1 client.4737 shutdown 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ae0c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.808 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5178002230 tx=0x7f5178026000 comp rx=0 tx=0).stop 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 shutdown_connections 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=CLOSED pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ae0c710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.797+0000 7f518d909480 1 --2- 172.21.15.103:0/2900768550 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.798+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 >> 172.21.15.103:0/2900768550 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.798+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 shutdown_connections 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.798+0000 7f518d909480 1 -- 172.21.15.103:0/2900768550 wait complete. 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.798+0000 7f518d909480 20 client.4737 trim_cache size 0 max 16384 2024-04-25T10:35:23.809 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.CheckZeroReclaimFlag (10 ms) 2024-04-25T10:35:23.810 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.CheckUnknownReclaimFlag 2024-04-25T10:35:23.816 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.798+0000 7f518d909480 1 -- start start 2024-04-25T10:35:23.816 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.799+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:23.816 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.799+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.816 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.799+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.816 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.816 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c00af70 con 0x55fa3ad801c0 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3aeab8c0 con 0x55fa3aea62c0 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3adf7690 con 0x55fa3aea3cc0 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50530/0 (socket says 172.21.15.103:50530) 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 -- 172.21.15.103:0/2844897671 learned_addr learned my addr 172.21.15.103:0/2844897671 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 -- 172.21.15.103:0/2844897671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3ad7a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 -- 172.21.15.103:0/2844897671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 -- 172.21.15.103:0/2844897671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ad7e9e0 con 0x55fa3ad801c0 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f51873d3640 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f518000b990 tx=0x7f5180002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8291cbcc5ae120 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:23.817 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.800+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180093040 con 0x55fa3ad801c0 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f5180062720 con 0x55fa3ad801c0 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 10 client.4740 Subscribing to map 'mdsmap' 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aea1f00 con 0x55fa3ad801c0 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f51767fc640 20 client.4740 tick 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f51767fc640 20 client.4740 collect_and_send_metrics 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f51767fc640 20 client.4740 collect_and_send_global_metrics 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f51767fc640 5 client.4740 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f51767fc640 20 client.4740 trim_cache size 0 max 16384 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f51767fc640 20 client.4740 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3ae04370 con 0x55fa3ad801c0 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066040 con 0x55fa3ad801c0 2024-04-25T10:35:23.818 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f5184bce640 1 client.4740 handle_mds_map epoch 6 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 20 client.4740 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 10 client.4740 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 20 client.4740 mds is 0 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 10 client.4740 _open_mds_session mds.0 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3aea6b20 con 0x55fa3aeb2d70 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f518d909480 10 client.4740 waiting for session to mds.0 to open 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.801+0000 7f5184bce640 10 client.4740 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.802+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c19c460cef07fc32 server_cookie=ff6f7dbfe39771a6 in_seq=0 out_seq=0 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3aea6b20 con 0x55fa3aeb2d70 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 renew_caps mds.0 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.819 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 connect_mds_targets for mds.0 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 10 client.4740 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 20 client.4740 mds is 0 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 10 client.4740 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 20 client.4740 encode_cap_releases enter (req: 0x55fa3aea67a0, mds: 0) 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 20 client.4740 send_request set sent_stamp to 2024-04-25T10:35:23.804873+0000 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 10 client.4740 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.801861+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.801861+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9f0d0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 20 client.4740 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c036040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 insert_trace from 2024-04-25T10:35:23.804873+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 features 0xffffffffffffffff 2024-04-25T10:35:23.820 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 update_snap_trace len 70 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 get_snap_realm 0x1 0x7f515c00b540, nref now is 1 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 15 client.4740 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 15 client.4740 snapc 1=[] 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 put_snap_realm 0x1 0x7f515c00b540 2 -> 1 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 hrm is_target=1 is_dentry=0 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b630) - ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.768072+0000 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 dir hash is 2 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 12 client.4740 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 12 client.4740 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b630) caps pAsLsXsFs 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 get_snap_realm 0x1 0x7f515c00b540, nref was 1 2024-04-25T10:35:23.821 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 get_snap_realm 0x1 0x7f515c00b540, nref now is 2 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 15 client.4740 add_update_cap first one, opened snaprealm 0x7f515c00b540 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 10 client.4740 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 put_snap_realm 0x1 0x7f515c00b540 2 -> 1 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 20 client.4740 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 20 client.4740 lat 0.000580 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 20 client.4740 _ll_get 0x7f515c00b630 0x1 -> 1 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_reclaim(unknownreclaimflag:a8d8 flags 0x2) -- 0x55fa3ae04370 con 0x55fa3aeb2d70 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.804+0000 7f5184bce640 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f5184bce640 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.822 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reclaim_reply(-22 e 0) ==== 13+0+0 (crc 0 0 0) 0x7f517c04e040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f5184bce640 10 client.4740 handle_client_reclaim_reply client_reclaim_reply(-22 e 0) from mds.0 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 2 client.4740 unmount 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 2 client.4740 unmounting 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 _ll_drop_pins 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 _ll_put 0x7f515c00b630 0x1 1 -> 0 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 nothing to flush 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.823 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 flush_caps_sync 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 trim_cache size 0 max 16384 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 8 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 15 client.4740 remove_cap last one, closing snaprealm 0x7f515c00b540 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 20 client.4740 put_snap_realm 0x1 0x7f515c00b540 1 -> 0 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 10 client.4740 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 2 client.4740 _close_mds_session mds.0 seq 0 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3ae9f280 con 0x55fa3aeb2d70 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.805+0000 7f518d909480 2 client.4740 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ae9f280 con 0x55fa3aeb2d70 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 10 client.4740 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 5 client.4740 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:23.824 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 1 -- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ae9eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 10 client.4740 remove_session_caps mds.0 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 10 client.4740 kick_requests_closed for mds.0 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 10 client.4740 unmounting: trim pass, size was 0+0 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 20 client.4740 trim_cache size 0 max 16384 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f5184bce640 10 client.4740 unmounting: trim pass, size still 0+0 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 2 client.4740 unmounted. 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 client.4740 shutdown 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f518000b990 tx=0x7f5180002fb0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 shutdown_connections 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=CLOSED pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3ad7a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.825 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 --2- 172.21.15.103:0/2844897671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 >> 172.21.15.103:0/2844897671 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 shutdown_connections 2024-04-25T10:35:23.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 1 -- 172.21.15.103:0/2844897671 wait complete. 2024-04-25T10:35:23.826 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.807+0000 7f518d909480 20 client.4740 trim_cache size 0 max 16384 2024-04-25T10:35:23.826 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.CheckUnknownReclaimFlag (10 ms) 2024-04-25T10:35:23.826 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.CheckNegativeReclaimFlagUnmasked 2024-04-25T10:35:23.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.808+0000 7f518d909480 1 -- start start 2024-04-25T10:35:23.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:23.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.832 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c00a320 con 0x55fa3aea3cc0 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3aea2510 con 0x55fa3ad801c0 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeba4a0 con 0x55fa3aea62c0 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50540/0 (socket says 172.21.15.103:50540) 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5186bd2640 1 -- 172.21.15.103:0/2139314819 learned_addr learned my addr 172.21.15.103:0/2139314819 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f51873d3640 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5186bd2640 1 -- 172.21.15.103:0/2139314819 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5186bd2640 1 -- 172.21.15.103:0/2139314819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.809+0000 7f5186bd2640 1 -- 172.21.15.103:0/2139314819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ad82920 con 0x55fa3aea3cc0 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f517c00b780 tx=0x55fa3ad805f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99b129ee15d7a20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:23.833 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c04e070 con 0x55fa3aea3cc0 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517c018e00 con 0x55fa3aea3cc0 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 10 client.4743 Subscribing to map 'mdsmap' 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aeb1180 con 0x55fa3aea3cc0 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5175ffb640 20 client.4743 tick 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5175ffb640 20 client.4743 collect_and_send_metrics 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5175ffb640 20 client.4743 collect_and_send_global_metrics 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5175ffb640 5 client.4743 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5175ffb640 20 client.4743 trim_cache size 0 max 16384 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5175ffb640 20 client.4743 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c074070 con 0x55fa3aea3cc0 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c061040 con 0x55fa3aea3cc0 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f5185bd0640 1 client.4743 handle_mds_map epoch 6 2024-04-25T10:35:23.834 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 20 client.4743 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 10 client.4743 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 20 client.4743 mds is 0 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 10 client.4743 _open_mds_session mds.0 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ad38640 con 0x55fa3aeb2d70 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f518d909480 10 client.4743 waiting for session to mds.0 to open 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.810+0000 7f51873d3640 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.811+0000 7f5185bd0640 10 client.4743 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.811+0000 7f51873d3640 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68d658777d3c6cd3 server_cookie=6732f710692a8e5f in_seq=0 out_seq=0 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ad38640 con 0x55fa3aeb2d70 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 renew_caps mds.0 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 connect_mds_targets for mds.0 2024-04-25T10:35:23.835 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 mds is 0 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 encode_cap_releases enter (req: 0x55fa3ad38280, mds: 0) 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 send_request set sent_stamp to 2024-04-25T10:35:23.813715+0000 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.811073+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.811073+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9f240 con 0x55fa3aeb2d70 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180062c60 con 0x55fa3aeb2d70 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 insert_trace from 2024-04-25T10:35:23.813715+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 features 0xffffffffffffffff 2024-04-25T10:35:23.836 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 update_snap_trace len 70 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 get_snap_realm 0x1 0x7f515c00b540, nref now is 1 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 15 client.4743 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 15 client.4743 snapc 1=[] 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 put_snap_realm 0x1 0x7f515c00b540 2 -> 1 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 hrm is_target=1 is_dentry=0 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b630) - ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.768072+0000 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 dir hash is 2 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 12 client.4743 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 12 client.4743 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b630) caps pAsLsXsFs 2024-04-25T10:35:23.837 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 get_snap_realm 0x1 0x7f515c00b540, nref was 1 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 get_snap_realm 0x1 0x7f515c00b540, nref now is 2 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 15 client.4743 add_update_cap first one, opened snaprealm 0x7f515c00b540 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 put_snap_realm 0x1 0x7f515c00b540 2 -> 1 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 lat 0.000429 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 _ll_get 0x7f515c00b630 0x1 -> 1 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_reclaim(unknownreclaimflag:a8d8 flags 0x7fffffff) -- 0x55fa3ae9f240 con 0x55fa3aeb2d70 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reclaim_reply(-22 e 0) ==== 13+0+0 (crc 0 0 0) 0x7f5180093040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.838 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f5185bd0640 10 client.4743 handle_client_reclaim_reply client_reclaim_reply(-22 e 0) from mds.0 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 2 client.4743 unmount 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 2 client.4743 unmounting 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 _ll_drop_pins 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 _ll_put 0x7f515c00b630 0x1 1 -> 0 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 nothing to flush 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.839 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 flush_caps_sync 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 trim_cache size 0 max 16384 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 8 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 15 client.4743 remove_cap last one, closing snaprealm 0x7f515c00b540 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 20 client.4743 put_snap_realm 0x1 0x7f515c00b540 1 -> 0 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 10 client.4743 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 2 client.4743 _close_mds_session mds.0 seq 0 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3adf3f40 con 0x55fa3aeb2d70 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.813+0000 7f518d909480 2 client.4743 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adf3f40 con 0x55fa3aeb2d70 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 10 client.4743 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:23.840 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 5 client.4743 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 1 -- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ae9eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 10 client.4743 remove_session_caps mds.0 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 10 client.4743 kick_requests_closed for mds.0 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 10 client.4743 unmounting: trim pass, size was 0+0 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 20 client.4743 trim_cache size 0 max 16384 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f5185bd0640 10 client.4743 unmounting: trim pass, size still 0+0 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 2 client.4743 unmounted. 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 client.4743 shutdown 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aea67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f517c00b780 tx=0x55fa3ad805f0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 shutdown_connections 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=CLOSED pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.841 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 --2- 172.21.15.103:0/2139314819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.815+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 >> 172.21.15.103:0/2139314819 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.816+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 shutdown_connections 2024-04-25T10:35:23.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.816+0000 7f518d909480 1 -- 172.21.15.103:0/2139314819 wait complete. 2024-04-25T10:35:23.842 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.816+0000 7f518d909480 20 client.4743 trim_cache size 0 max 16384 2024-04-25T10:35:23.842 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.CheckNegativeReclaimFlagUnmasked (8 ms) 2024-04-25T10:35:23.842 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.CheckNegativeReclaimFlag 2024-04-25T10:35:23.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.816+0000 7f518d909480 1 -- start start 2024-04-25T10:35:23.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.817+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:23.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.817+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.817+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.817+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.817+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c00aec0 con 0x55fa3aea3cc0 2024-04-25T10:35:23.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.817+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3aeb87b0 con 0x55fa3ad801c0 2024-04-25T10:35:23.849 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.817+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad79fa0 con 0x55fa3aea62c0 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50554/0 (socket says 172.21.15.103:50554) 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 -- 172.21.15.103:0/1761555562 learned_addr learned my addr 172.21.15.103:0/1761555562 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f51873d3640 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 -- 172.21.15.103:0/1761555562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 -- 172.21.15.103:0/1761555562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 -- 172.21.15.103:0/1761555562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ad7b640 con 0x55fa3aea3cc0 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f517c016a00 tx=0x7f517c05e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fa5e8e4cc61131 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:23.850 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c06b080 con 0x55fa3aea3cc0 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517c018e00 con 0x55fa3aea3cc0 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f518d909480 10 client.4746 Subscribing to map 'mdsmap' 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3adf7a30 con 0x55fa3aea3cc0 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f51767fc640 20 client.4746 tick 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f51767fc640 20 client.4746 collect_and_send_metrics 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f51767fc640 20 client.4746 collect_and_send_global_metrics 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f51767fc640 5 client.4746 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f51767fc640 20 client.4746 trim_cache size 0 max 16384 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.818+0000 7f51767fc640 20 client.4746 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c074070 con 0x55fa3aea3cc0 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c061040 con 0x55fa3aea3cc0 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f5184bce640 1 client.4746 handle_mds_map epoch 6 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f518d909480 20 client.4746 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f518d909480 10 client.4746 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.851 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f518d909480 20 client.4746 mds is 0 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f518d909480 10 client.4746 _open_mds_session mds.0 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f518d909480 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad7e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae9ef00 con 0x55fa3aeb2d70 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f518d909480 10 client.4746 waiting for session to mds.0 to open 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f51873d3640 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad7e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f5184bce640 10 client.4746 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.819+0000 7f51873d3640 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad7e3b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=309d83e6a807c94b server_cookie=8cd675d1744a9f11 in_seq=0 out_seq=0 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae9ef00 con 0x55fa3aeb2d70 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f5184bce640 10 client.4746 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f5184bce640 10 client.4746 renew_caps mds.0 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f5184bce640 10 client.4746 connect_mds_targets for mds.0 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f518d909480 10 client.4746 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.852 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f518d909480 20 client.4746 mds is 0 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f518d909480 10 client.4746 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f518d909480 20 client.4746 encode_cap_releases enter (req: 0x55fa3ae9eb90, mds: 0) 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f518d909480 20 client.4746 send_request set sent_stamp to 2024-04-25T10:35:23.822481+0000 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f518d909480 10 client.4746 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.819702+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.821+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.819702+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf3f40 con 0x55fa3aeb2d70 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180062c60 con 0x55fa3aeb2d70 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 insert_trace from 2024-04-25T10:35:23.822481+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 features 0xffffffffffffffff 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 update_snap_trace len 70 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:23.853 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 get_snap_realm 0x1 0x7f515c00b540, nref now is 1 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 15 client.4746 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 15 client.4746 snapc 1=[] 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 put_snap_realm 0x1 0x7f515c00b540 2 -> 1 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 hrm is_target=1 is_dentry=0 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b630) - ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.768072+0000 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 dir hash is 2 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 12 client.4746 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-04-25T10:35:23.854 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 12 client.4746 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b630) caps pAsLsXsFs 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 get_snap_realm 0x1 0x7f515c00b540, nref was 1 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 get_snap_realm 0x1 0x7f515c00b540, nref now is 2 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 15 client.4746 add_update_cap first one, opened snaprealm 0x7f515c00b540 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 put_snap_realm 0x1 0x7f515c00b540 2 -> 1 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 lat 0.000401 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 _ll_get 0x7f515c00b630 0x1 -> 1 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_reclaim(unknownreclaimflag:a8d8 flags 0xffffffff) -- 0x55fa3aea2080 con 0x55fa3aeb2d70 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.855 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reclaim_reply(-22 e 0) ==== 13+0+0 (crc 0 0 0) 0x7f5180093040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f5184bce640 10 client.4746 handle_client_reclaim_reply client_reclaim_reply(-22 e 0) from mds.0 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 2 client.4746 unmount 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 2 client.4746 unmounting 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 _ll_drop_pins 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 _ll_put 0x7f515c00b630 0x1 1 -> 0 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 nothing to flush 2024-04-25T10:35:23.856 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 1 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 flush_caps_sync 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 trim_cache size 0 max 16384 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) n = 8 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 15 client.4746 remove_cap last one, closing snaprealm 0x7f515c00b540 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 20 client.4746 put_snap_realm 0x1 0x7f515c00b540 1 -> 0 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 10 client.4746 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b630) 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 2 client.4746 _close_mds_session mds.0 seq 0 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3adf40f0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.822+0000 7f518d909480 2 client.4746 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adf40f0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 10 client.4746 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:23.857 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 5 client.4746 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 1 -- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ad7e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad7e3b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 10 client.4746 remove_session_caps mds.0 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 10 client.4746 kick_requests_closed for mds.0 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 10 client.4746 unmounting: trim pass, size was 0+0 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 20 client.4746 trim_cache size 0 max 16384 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f5184bce640 10 client.4746 unmounting: trim pass, size still 0+0 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 2 client.4746 unmounted. 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 client.4746 shutdown 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aea67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f517c016a00 tx=0x7f517c05e040 comp rx=0 tx=0).stop 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 shutdown_connections 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ad7e3b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.858 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.859 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 --2- 172.21.15.103:0/1761555562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.859 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 >> 172.21.15.103:0/1761555562 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.859 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 shutdown_connections 2024-04-25T10:35:23.859 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 1 -- 172.21.15.103:0/1761555562 wait complete. 2024-04-25T10:35:23.859 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.825+0000 7f518d909480 20 client.4746 trim_cache size 0 max 16384 2024-04-25T10:35:23.859 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.CheckNegativeReclaimFlag (10 ms) 2024-04-25T10:35:23.859 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameRemount 2024-04-25T10:35:23.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.826+0000 7f518d909480 1 -- start start 2024-04-25T10:35:23.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:23.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.876 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c00a270 con 0x55fa3ad801c0 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae03e90 con 0x55fa3aea62c0 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad7a690 con 0x55fa3aea3cc0 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50566/0 (socket says 172.21.15.103:50566) 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f51873d3640 1 -- 172.21.15.103:0/3030074353 learned_addr learned my addr 172.21.15.103:0/3030074353 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.827+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f51873d3640 1 -- 172.21.15.103:0/3030074353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aea67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f51873d3640 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f51873d3640 1 -- 172.21.15.103:0/3030074353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f51873d3640 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f51873d3640 1 -- 172.21.15.103:0/3030074353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae04e10 con 0x55fa3ad801c0 2024-04-25T10:35:23.877 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f51873d3640 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5180003060 tx=0x7f518006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea025563566219c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800bc060 con 0x55fa3ad801c0 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f518005ec10 con 0x55fa3ad801c0 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 10 client.4749 Subscribing to map 'mdsmap' 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae9f3f0 con 0x55fa3ad801c0 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5175ffb640 20 client.4749 tick 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5175ffb640 20 client.4749 collect_and_send_metrics 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5175ffb640 20 client.4749 collect_and_send_global_metrics 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5175ffb640 5 client.4749 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5175ffb640 20 client.4749 trim_cache size 0 max 16384 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5175ffb640 20 client.4749 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3aea2080 con 0x55fa3ad801c0 2024-04-25T10:35:23.878 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066040 con 0x55fa3ad801c0 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f5185bd0640 1 client.4749 handle_mds_map epoch 6 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 20 client.4749 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 10 client.4749 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 20 client.4749 mds is 0 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 10 client.4749 _open_mds_session mds.0 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ad7b420 con 0x55fa3aeb2d70 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.828+0000 7f518d909480 10 client.4749 waiting for session to mds.0 to open 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.829+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.829+0000 7f5185bd0640 10 client.4749 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.829+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4de7f7e4b8e8ec0f server_cookie=7ea2eeb57b41ab1b in_seq=0 out_seq=0 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ad7b420 con 0x55fa3aeb2d70 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:23.879 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 renew_caps mds.0 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 connect_mds_targets for mds.0 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 mds is 0 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 encode_cap_releases enter (req: 0x55fa3ad38280, mds: 0) 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 send_request set sent_stamp to 2024-04-25T10:35:23.831834+0000 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.829377+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.829377+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf3f40 con 0x55fa3aeb2d70 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b320 con 0x55fa3aeb2d70 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c036040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.880 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 insert_trace from 2024-04-25T10:35:23.831834+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 features 0xffffffffffffffff 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 update_snap_trace len 70 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 get_snap_realm 0x1 0x7f515c003d30, nref now is 1 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 15 client.4749 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 15 client.4749 snapc 1=[] 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 put_snap_realm 0x1 0x7f515c003d30 2 -> 1 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 hrm is_target=1 is_dentry=0 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b540) - ctime 2024-04-25T10:35:18.768072+0000 mtime 2024-04-25T10:35:18.768072+0000 2024-04-25T10:35:23.881 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 dir hash is 2 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 12 client.4749 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 12 client.4749 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=- has_dir_layout 0x7f515c00b540) caps pAsLsXsFs 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 get_snap_realm 0x1 0x7f515c003d30, nref was 1 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 get_snap_realm 0x1 0x7f515c003d30, nref now is 2 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 15 client.4749 add_update_cap first one, opened snaprealm 0x7f515c003d30 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 10 client.4749 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 put_snap_realm 0x1 0x7f515c003d30 2 -> 1 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 lat 0.000427 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 _ll_get 0x7f515c00b540 0x1 -> 1 2024-04-25T10:35:23.882 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 mkdirat: AlternateNameRemount_43224 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f5185bd0640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 path_walk 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 may_create 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 _getattr mask As issued=1 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 3 client.4749 may_create 0x7f515c00b540 = 0 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 8 client.4749 _mkdir(0x1 AlternateNameRemount_43224, 0777, uid 0, gid 0) 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 get_or_create 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) name AlternateNameRemount_43224 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 15 open_dir 0x55fa3ad386c0 on 0x7f515c00b540 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 15 client.4749 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) 'AlternateNameRemount_43224' dn 0x1.head["AlternateNameRemount_43224"] (new dn) 2024-04-25T10:35:23.883 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 _mkdir: making request 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 choose_target_mds inode dir hash is 2 on AlternateNameRemount_43224 => 3409334272 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 choose_target_mds 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) is_hash=1 hash=3409334272 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 mds is 0 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 encode_cap_releases enter (req: 0x55fa3adf3f40, mds: 0) 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 encode_dentry_release enter(dn:0x7f515c00b230) 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b540), req:0x55fa3adf3f40 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 send_request set sent_stamp to 2024-04-25T10:35:23.832342+0000 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 10 client.4749 send_request client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameRemount_43224 (foo) 2024-04-25T10:35:23.832321+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameRemount_43224 (foo) 2024-04-25T10:35:23.832321+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf43f0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.831+0000 7f518d909480 20 client.4749 awaiting reply|forward|kick on 0x7ffc16ba7940 2024-04-25T10:35:23.884 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 832+0+0 (crc 0 0 0) 0x7f517c018e00 con 0x55fa3aeb2d70 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 insert_trace from 2024-04-25T10:35:23.832342+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 features 0xffffffffffffffff 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 update_snap_trace len 70 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 get_snap_realm 0x1 0x7f515c003d30, nref was 1 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 get_snap_realm 0x1 0x7f515c003d30, nref now is 2 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 hrm is_target=1 is_dentry=1 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 update_inode_file_time 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00bb20) - ctime 2024-04-25T10:35:23.832321+0000 mtime 2024-04-25T10:35:23.832321+0000 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 dir hash is 2 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 12 client.4749 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 12 client.4749 add_update_inode adding 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=- 0x7f515c00bb20) caps pAsxLsXsxFsx 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 get_snap_realm 0x1 0x7f515c003d30, nref was 2 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 get_snap_realm 0x1 0x7f515c003d30, nref now is 3 2024-04-25T10:35:23.885 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 15 client.4749 add_update_cap first one, opened snaprealm 0x7f515c003d30 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 add_update_cap issued - -> pAsxLsXsxFsx from mds.0 on 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f515c00bb20) 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f515c00bb20) 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 12 client.4749 add_update_inode had 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) caps pAsLsXs 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 update_inode_file_time 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:18.768072+0000 ctime=2024-04-25T10:35:18.768072+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) pAsLsXs ctime 2024-04-25T10:35:23.832321+0000 mtime 2024-04-25T10:35:23.832321+0000 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 dir hash is 2 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 12 client.4749 add_update_inode client inode change_attr: 15 , mds inodestat change_attr: 16 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 12 client.4749 insert_dentry_inode 'AlternateNameRemount_43224' vino 0x10000000008.head in dir 0x1.head dn 0x7f515c00b230 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 15 client.4749 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) 'AlternateNameRemount_43224' to inode 0x7f515c00bb20 dn 0x1.head["AlternateNameRemount_43224"] (old dn) 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 put_inode on 0x10000000008.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb20) n = 1 2024-04-25T10:35:23.886 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 link inode 0x7f515c00bb20 parents now 0x1.head["AlternateNameRemount_43224"] 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 put_inode on 0x10000000008.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb20) n = 1 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 15 client.4749 update_dentry_lease 0x1.head["AlternateNameRemount_43224"] lease(mask 7 dur 30000 altn foo)) from 2024-04-25T10:35:23.832342+0000 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 got dentry lease on AlternateNameRemount_43224 dur 30000ms ttl 2024-04-25T10:35:53.832342+0000 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 put_snap_realm 0x1 0x7f515c003d30 3 -> 2 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 handle_client_reply signalling caller 0x7ffc16ba7940 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 handle_client_reply awaiting kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 sendrecv kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 lat 0.002583 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _mkdir result is 0 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 trim_cache size 1 max 16384 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 8 client.4749 _mkdir(#0x1/AlternateNameRemount_43224, 040777) = 0 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 2 client.4749 unmount 2024-04-25T10:35:23.887 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 put_inode on 0x10000000008.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb20) n = 1 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 unmounting: trim pass, size was 1+2 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 trim_cache size 1 max 16384 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 15 client.4749 trim_dentry unlinking dn AlternateNameRemount_43224 in dir 0x1 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 15 client.4749 unlink dir 0x7f515c00b540 'AlternateNameRemount_43224' dn 0x7f515c00b230 inode 0x7f515c00bb20 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 put_inode on 0x10000000008.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) n = 1 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 unlink inode 0x7f515c00bb20 parents now 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 15 client.4749 unlink removing 'AlternateNameRemount_43224' dn 0x7f515c00b230 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 15 client.4749 close_dir dir 0x55fa3ad386c0 on 0x7f515c00b540 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 20 client.4749 put_inode on 0x10000000008.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) n = 1 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f5185bd0640 10 client.4749 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 2 client.4749 unmounting 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.888 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _ll_drop_pins 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 _ll_put 0x7f515c00b540 0x1 1 -> 0 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 _release 0x10000000008.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _invalidate_inode_cache 0x10000000008.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _flush 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 nothing to flush 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) n = 1 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 _release 0x1.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _flush 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 nothing to flush 2024-04-25T10:35:23.889 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) n = 1 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 1 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 flush_caps_sync 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 trim_cache size 0 max 16384 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) n = 14 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 15 client.4749 remove_cap last one, closing snaprealm 0x7f515c003d30 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_snap_realm 0x1 0x7f515c003d30 2 -> 1 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=- has_dir_layout 0x7f515c00b540) 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) n = 7 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 remove_cap mds.0 on 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f515c00bb20) 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 15 client.4749 remove_cap last one, closing snaprealm 0x7f515c003d30 2024-04-25T10:35:23.890 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 20 client.4749 put_snap_realm 0x1 0x7f515c003d30 1 -> 0 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 10 client.4749 _put_inode deleting 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=- COMPLETE 0x7f515c00bb20) 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 2 client.4749 _close_mds_session mds.0 seq 0 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close) -- 0x55fa3adf43f0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.834+0000 7f518d909480 2 client.4749 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adf43f0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 10 client.4749 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 5 client.4749 _closed_mds_session mds.0 seq 0 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 1 -- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ae9eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 10 client.4749 remove_session_caps mds.0 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 10 client.4749 kick_requests_closed for mds.0 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 10 client.4749 unmounting: trim pass, size was 0+0 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 20 client.4749 trim_cache size 0 max 16384 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f5185bd0640 10 client.4749 unmounting: trim pass, size still 0+0 2024-04-25T10:35:23.891 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f518d909480 2 client.4749 unmounted. 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.838+0000 7f518d909480 1 client.4749 shutdown 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5180003060 tx=0x7f518006d000 comp rx=0 tx=0).stop 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 shutdown_connections 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=CLOSED pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 --2- 172.21.15.103:0/3030074353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 >> 172.21.15.103:0/3030074353 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 shutdown_connections 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 -- 172.21.15.103:0/3030074353 wait complete. 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 20 client.4749 trim_cache size 0 max 16384 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.839+0000 7f518d909480 1 -- start start 2024-04-25T10:35:23.892 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.840+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c006b20 con 0x55fa3aea3cc0 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3aea1f90 con 0x55fa3ad801c0 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aeb87b0 con 0x55fa3aea62c0 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50578/0 (socket says 172.21.15.103:50578) 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 -- 172.21.15.103:0/3139220174 learned_addr learned my addr 172.21.15.103:0/3139220174 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f51873d3640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 -- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 -- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.893 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae055e0 con 0x55fa3aea3cc0 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f517c0182d0 tx=0x7f517c062000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f2d2d1f815d5ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c06b040 con 0x55fa3aea3cc0 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517c016440 con 0x55fa3aea3cc0 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f518d909480 10 client.4752 Subscribing to map 'mdsmap' 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ad82920 con 0x55fa3aea3cc0 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f51767fc640 20 client.4752 tick 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f51767fc640 20 client.4752 collect_and_send_metrics 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f51767fc640 20 client.4752 collect_and_send_global_metrics 2024-04-25T10:35:23.894 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f51767fc640 5 client.4752 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.841+0000 7f51767fc640 20 client.4752 trim_cache size 0 max 16384 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f51767fc640 20 client.4752 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c07f070 con 0x55fa3aea3cc0 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c061040 con 0x55fa3aea3cc0 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f5184bce640 1 client.4752 handle_mds_map epoch 6 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f518d909480 20 client.4752 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f518d909480 10 client.4752 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f518d909480 20 client.4752 mds is 0 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f518d909480 10 client.4752 _open_mds_session mds.0 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f518d909480 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae03d50 con 0x55fa3aeb2d70 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f518d909480 10 client.4752 waiting for session to mds.0 to open 2024-04-25T10:35:23.895 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f51873d3640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f5184bce640 10 client.4752 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.842+0000 7f51873d3640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9be1a6f587ac4ee7 server_cookie=9c12802a14f1376c in_seq=0 out_seq=0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae03d50 con 0x55fa3aeb2d70 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 renew_caps mds.0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b280 con 0x55fa3aeb2d70 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 connect_mds_targets for mds.0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 mds is 0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 encode_cap_releases enter (req: 0x55fa3ae05db0, mds: 0) 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 send_request set sent_stamp to 2024-04-25T10:35:23.845639+0000 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.842674+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.842674+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf3f40 con 0x55fa3aeb2d70 2024-04-25T10:35:23.896 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 awaiting reply|forward|kick on 0x7ffc16ba7a70 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b280 con 0x55fa3aeb2d70 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180062c60 con 0x55fa3aeb2d70 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 insert_trace from 2024-04-25T10:35:23.845639+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 features 0xffffffffffffffff 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 update_snap_trace len 70 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref now is 1 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 15 client.4752 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 15 client.4752 snapc 1=[] 2024-04-25T10:35:23.897 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 put_snap_realm 0x1 0x7f515c00b4a0 2 -> 1 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 hrm is_target=1 is_dentry=0 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b590) - ctime 2024-04-25T10:35:23.832321+0000 mtime 2024-04-25T10:35:23.832321+0000 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 dir hash is 2 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 12 client.4752 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 16 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 12 client.4752 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=- has_dir_layout 0x7f515c00b590) caps pAsLsXsFs 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref was 1 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref now is 2 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 15 client.4752 add_update_cap first one, opened snaprealm 0x7f515c00b4a0 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 10 client.4752 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 put_snap_realm 0x1 0x7f515c00b4a0 2 -> 1 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 handle_client_reply signalling caller 0x7ffc16ba7a70 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:23.898 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 lat 0.000580 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 _ll_get 0x7f515c00b590 0x1 -> 1 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 walk: AlternateNameRemount_43224 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 path_walk AlternateNameRemount_43224 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 0 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) AlternateNameRemount_43224 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 (path is AlternateNameRemount_43224) 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 may_lookup 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 _getattr mask As issued=1 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 3 client.4752 may_lookup 0x7f515c00b590 = 0 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 _do_lookup on #0x1/AlternateNameRemount_43224 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRemount_43224 => 3409334272 2024-04-25T10:35:23.899 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) is_hash=1 hash=3409334272 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 mds is 0 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 encode_cap_releases enter (req: 0x55fa3adf3f40, mds: 0) 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 send_request set sent_stamp to 2024-04-25T10:35:23.846261+0000 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 10 client.4752 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameRemount_43224 2024-04-25T10:35:23.846246+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/AlternateNameRemount_43224 2024-04-25T10:35:23.846246+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf4360 con 0x55fa3aeb2d70 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f518d909480 20 client.4752 awaiting reply|forward|kick on 0x7ffc16ba7780 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.845+0000 7f5184bce640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success) ==== 832+0+0 (crc 0 0 0) 0x7f518000a040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 insert_trace from 2024-04-25T10:35:23.846261+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 features 0xffffffffffffffff 2024-04-25T10:35:23.900 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 update_snap_trace len 70 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref was 1 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref now is 2 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 hrm is_target=1 is_dentry=1 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 update_inode_file_time 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00bb70) - ctime 2024-04-25T10:35:23.832321+0000 mtime 2024-04-25T10:35:23.832321+0000 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 dir hash is 2 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 12 client.4752 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 12 client.4752 add_update_inode adding 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=- 0x7f515c00bb70) caps pAsLsXsFs 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref was 2 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref now is 3 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 15 client.4752 add_update_cap first one, opened snaprealm 0x7f515c00b4a0 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) 0x7f515c00bb70) 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) 0x7f515c00bb70) 2024-04-25T10:35:23.901 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 12 client.4752 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) caps pAsLsXsFs 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 dir hash is 2 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 12 client.4752 add_update_inode client inode change_attr: 16 , mds inodestat change_attr: 16 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 10 client.4752 add_update_cap issued pAsLsXsFs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 15 open_dir 0x7f515c004190 on 0x7f515c00b590 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 12 client.4752 insert_dentry_inode 'AlternateNameRemount_43224' vino 0x10000000008.head in dir 0x1.head dn 0 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 15 client.4752 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) 'AlternateNameRemount_43224' to inode 0x10000000008.head(faked_ino=0 nref=2 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE 0x7f515c00bb70) dn 0x1.head["AlternateNameRemount_43224"] (new dn) 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 link inode 0x7f515c00bb70 parents now 0x1.head["AlternateNameRemount_43224"] 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 15 client.4752 update_dentry_lease 0x1.head["AlternateNameRemount_43224"] lease(mask 0 dur 0 altn foo)) from 2024-04-25T10:35:23.846261+0000 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 put_snap_realm 0x1 0x7f515c00b4a0 3 -> 2 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 handle_client_reply signalling caller 0x7ffc16ba7780 2024-04-25T10:35:23.902 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 make_request target is 0x10000000008.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 lat 0.000602 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 10 client.4752 _do_lookup res is 0 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 _lookup have 0x1.head["AlternateNameRemount_43224"] from mds.-1 ttl 0.000000 seq 0 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 10 client.4752 _lookup 0x1.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) AlternateNameRemount_43224 = 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f5184bce640 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.903 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 10 client.4752 path_walk 2024-04-25T10:35:23.904 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.904 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.904 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 may_delete 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590); ; name AlternateNameRemount_43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 10 client.4752 _getattr mask As issued=1 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 3 client.4752 may_delete 0x7f515c00b590 = 0 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 8 client.4752 _rmdir(0x1 AlternateNameRemount_43224 uid 0 gid 0) 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 get_or_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) name AlternateNameRemount_43224 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 _lookup have 0x1.head["AlternateNameRemount_43224"] from mds.-1 ttl 0.000000 seq 0 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 10 client.4752 _lookup 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) AlternateNameRemount_43224 = 0x10000000008.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70) 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRemount_43224 => 3409334272 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590) is_hash=1 hash=3409334272 2024-04-25T10:35:23.905 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 10 client.4752 choose_target_mds from dirfragtree hash 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 mds is 0 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 10 client.4752 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 encode_cap_releases enter (req: 0x55fa3adf4360, mds: 0) 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 encode_inode_release enter(in:0x10000000008.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_43224"] 0x7f515c00bb70), req:0x55fa3adf4360 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 encode_dentry_release enter(dn:0x7f515c004200) 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b590), req:0x55fa3adf4360 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 send_request set sent_stamp to 2024-04-25T10:35:23.846972+0000 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 10 client.4752 send_request client_request(unknown.0:3 rmdir #0x1/AlternateNameRemount_43224 2024-04-25T10:35:23.846950+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 rmdir #0x1/AlternateNameRemount_43224 2024-04-25T10:35:23.846950+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf4750 con 0x55fa3aeb2d70 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.846+0000 7f518d909480 20 client.4752 awaiting reply|forward|kick on 0x7ffc16ba7a10 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 498+0+0 (crc 0 0 0) 0x7f51800624a0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 handle_client_reply got a reply. Safe:0 tid 3 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 10 client.4752 insert_trace from 2024-04-25T10:35:23.846972+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:23.906 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 10 client.4752 features 0xffffffffffffffff 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 10 client.4752 update_snap_trace len 70 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref was 2 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 get_snap_realm 0x1 0x7f515c00b4a0, nref now is 3 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 10 client.4752 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 10 client.4752 hrm is_target=0 is_dentry=1 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 12 client.4752 add_update_inode had 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) caps pAsLsXs 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) pAsLsXs ctime 2024-04-25T10:35:23.846950+0000 mtime 2024-04-25T10:35:23.832321+0000 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 dir hash is 2 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 12 client.4752 add_update_inode client inode change_attr: 16 , mds inodestat change_attr: 17 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 10 client.4752 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 15 client.4752 unlink dir 0x7f515c00b590 'AlternateNameRemount_43224' dn 0x7f515c004200 inode 0x7f515c00bb70 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.907 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 unlink inode 0x7f515c00bb70 parents now 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 15 client.4752 update_dentry_lease 0x1.head["AlternateNameRemount_43224"] lease(mask 3 dur 30000 altn foo)) from 2024-04-25T10:35:23.846972+0000 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 10 client.4752 got dentry lease on AlternateNameRemount_43224 dur 30000ms ttl 2024-04-25T10:35:53.846972+0000 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 put_snap_realm 0x1 0x7f515c00b4a0 3 -> 2 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 handle_client_reply signalling caller 0x7ffc16ba7a10 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f5184bce640 20 client.4752 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 20 client.4752 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 20 client.4752 lat 0.001808 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 20 client.4752 trim_cache size 1 max 16384 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 8 client.4752 rmdir(#0x1/AlternateNameRemount_43224) = 0 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.908 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 2 client.4752 unmount 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 2 client.4752 unmounting 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3adf4750 con 0x55fa3aeb2d70 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.848+0000 7f518d909480 10 client.4752 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(grant ino 0x10000000008 27 seq 2 caps=pAsLsXsFsx dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.832321+0000 ctime 2024-04-25T10:35:23.846950+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f5180062690 con 0x55fa3aeb2d70 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 5 client.4752 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 mds.0 seq now 1 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 5 client.4752 handle_cap_grant on in 0x10000000008 mds.0 seq 2 caps now pAsLsXsFsx was pAsXsFs 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 update_inode_file_time 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.832321+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00bb70) pAsXsFs ctime 2024-04-25T10:35:23.846950+0000 mtime 2024-04-25T10:35:23.832321+0000 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 grant, new caps are LsFx 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 5 client.4752 _try_to_trim_inode in 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 unmounting: trim pass, size was 1+2 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 20 client.4752 trim_cache size 1 max 16384 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 unmounting: trim pass, size still 1+2 2024-04-25T10:35:23.909 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f518005e040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 insert_trace from 2024-04-25T10:35:23.846972+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 5 client.4752 _try_to_trim_inode in 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 unmounting: trim pass, size was 1+2 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 20 client.4752 trim_cache size 1 max 16384 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 15 client.4752 trim_dentry unlinking dn AlternateNameRemount_43224 in dir 0x1 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 15 client.4752 unlink dir 0x7f515c00b590 'AlternateNameRemount_43224' dn 0x7f515c004200 inode 0 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 15 client.4752 unlink removing 'AlternateNameRemount_43224' dn 0x7f515c004200 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 15 client.4752 close_dir dir 0x7f515c004190 on 0x7f515c00b590 2024-04-25T10:35:23.910 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f5184bce640 10 client.4752 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _ll_drop_pins 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 _ll_put 0x7f515c00b590 0x1 1 -> 0 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 _release 0x10000000008.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _invalidate_inode_cache 0x10000000008.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _flush 0x10000000008.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 nothing to flush 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 _release 0x1.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.911 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _flush 0x1.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 nothing to flush 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_inode on 0x10000000008.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) n = 1 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 1 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 flush_caps_sync 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 trim_cache size 0 max 16384 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) n = 16 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 15 client.4752 remove_cap last one, closing snaprealm 0x7f515c00b4a0 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_snap_realm 0x1 0x7f515c00b4a0 2 -> 1 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=- has_dir_layout 0x7f515c00b590) 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _put_inode on 0x10000000008.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) n = 12 2024-04-25T10:35:23.912 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 remove_cap mds.0 on 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00bb70) 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 15 client.4752 remove_cap last one, closing snaprealm 0x7f515c00b4a0 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 20 client.4752 put_snap_realm 0x1 0x7f515c00b4a0 1 -> 0 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 10 client.4752 _put_inode deleting 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.832321+0000 mtime=2024-04-25T10:35:23.832321+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=1 caps=- COMPLETE 0x7f515c00bb70) 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 2 client.4752 _close_mds_session mds.0 seq 1 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 1) -- 0x55fa3adf4b10 con 0x55fa3aeb2d70 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.850+0000 7f518d909480 2 client.4752 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adf4750 con 0x55fa3aeb2d70 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 10 client.4752 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 5 client.4752 _closed_mds_session mds.0 seq 1 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 1 -- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3ae9eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 10 client.4752 remove_session_caps mds.0 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 10 client.4752 kick_requests_closed for mds.0 2024-04-25T10:35:23.913 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 10 client.4752 unmounting: trim pass, size was 0+0 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 20 client.4752 trim_cache size 0 max 16384 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f5184bce640 10 client.4752 unmounting: trim pass, size still 0+0 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 2 client.4752 unmounted. 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 client.4752 shutdown 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aea67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f517c0182d0 tx=0x7f517c062000 comp rx=0 tx=0).stop 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 shutdown_connections 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3ae9eb90 unknown :-1 s=CLOSED pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 --2- 172.21.15.103:0/3139220174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 >> 172.21.15.103:0/3139220174 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 shutdown_connections 2024-04-25T10:35:23.914 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 1 -- 172.21.15.103:0/3139220174 wait complete. 2024-04-25T10:35:23.915 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.853+0000 7f518d909480 20 client.4752 trim_cache size 0 max 16384 2024-04-25T10:35:23.915 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameRemount (27 ms) 2024-04-25T10:35:23.915 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameMkdir 2024-04-25T10:35:23.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.854+0000 7f518d909480 1 -- start start 2024-04-25T10:35:23.925 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.854+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ae9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c00a6d0 con 0x55fa3aea3cc0 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3aea4fa0 con 0x55fa3ad801c0 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ae9fbb0 con 0x55fa3aea62c0 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50594/0 (socket says 172.21.15.103:50594) 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 -- 172.21.15.103:0/940477062 learned_addr learned my addr 172.21.15.103:0/940477062 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5187bd4640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f51873d3640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ae9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 -- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.926 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 -- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3ae9eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ae9eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ad38280 con 0x55fa3aea3cc0 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f51873d3640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ae9eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5186bd2640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f517c032040 tx=0x55fa3ae03f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ca8a42b94fc0ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c06b070 con 0x55fa3aea3cc0 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 10 client.4755 Subscribing to map 'mdsmap' 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.855+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517c018e00 con 0x55fa3aea3cc0 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3adf39b0 con 0x55fa3aea3cc0 2024-04-25T10:35:23.927 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5175ffb640 20 client.4755 tick 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5175ffb640 20 client.4755 collect_and_send_metrics 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5175ffb640 20 client.4755 collect_and_send_global_metrics 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5175ffb640 5 client.4755 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5175ffb640 20 client.4755 trim_cache size 0 max 16384 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5175ffb640 20 client.4755 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c074070 con 0x55fa3aea3cc0 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c061050 con 0x55fa3aea3cc0 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5185bd0640 1 client.4755 handle_mds_map epoch 6 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 20 client.4755 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 10 client.4755 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 20 client.4755 mds is 0 2024-04-25T10:35:23.928 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 10 client.4755 _open_mds_session mds.0 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3adffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3adf7690 con 0x55fa3aeb2d70 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f518d909480 10 client.4755 waiting for session to mds.0 to open 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f51873d3640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3adffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.856+0000 7f5185bd0640 10 client.4755 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.857+0000 7f51873d3640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3adffb70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703dc1658bd29337 server_cookie=4efa6c4879cdbe11 in_seq=0 out_seq=0 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3adf7690 con 0x55fa3aeb2d70 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f5185bd0640 10 client.4755 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f5185bd0640 10 client.4755 renew_caps mds.0 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b1a0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f5185bd0640 10 client.4755 connect_mds_targets for mds.0 2024-04-25T10:35:23.929 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f518d909480 10 client.4755 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f518d909480 20 client.4755 mds is 0 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f518d909480 10 client.4755 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f518d909480 20 client.4755 encode_cap_releases enter (req: 0x55fa3aea2240, mds: 0) 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f518d909480 20 client.4755 send_request set sent_stamp to 2024-04-25T10:35:23.859268+0000 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f518d909480 10 client.4755 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.856781+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.856781+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf3f40 con 0x55fa3aeb2d70 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f518d909480 20 client.4755 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b1a0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.858+0000 7f5185bd0640 10 client.4755 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180000bc0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:23.930 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 insert_trace from 2024-04-25T10:35:23.859268+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 features 0xffffffffffffffff 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 update_snap_trace len 70 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref now is 1 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 15 client.4755 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 15 client.4755 snapc 1=[] 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 put_snap_realm 0x1 0x7f515c00b3c0 2 -> 1 2024-04-25T10:35:23.931 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 hrm is_target=1 is_dentry=0 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b4b0) - ctime 2024-04-25T10:35:23.846950+0000 mtime 2024-04-25T10:35:23.846950+0000 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 dir hash is 2 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 12 client.4755 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 17 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 12 client.4755 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=- has_dir_layout 0x7f515c00b4b0) caps pAsLsXsFs 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref was 1 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref now is 2 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 15 client.4755 add_update_cap first one, opened snaprealm 0x7f515c00b3c0 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 10 client.4755 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 put_snap_realm 0x1 0x7f515c00b3c0 2 -> 1 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:23.932 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 lat 0.000440 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 _ll_get 0x7f515c00b4b0 0x1 -> 1 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 10 client.4755 mkdirat: AlternateNameMkdir_43224 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f5185bd0640 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 10 client.4755 path_walk 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 may_create 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 10 client.4755 _getattr mask As issued=1 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 3 client.4755 may_create 0x7f515c00b4b0 = 0 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 8 client.4755 _mkdir(0x1 AlternateNameMkdir_43224, 0777, uid 0, gid 0) 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 get_or_create 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) name AlternateNameMkdir_43224 2024-04-25T10:35:23.933 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 15 open_dir 0x55fa3ae9f0d0 on 0x7f515c00b4b0 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 15 client.4755 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) 'AlternateNameMkdir_43224' dn 0x1.head["AlternateNameMkdir_43224"] (new dn) 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 10 client.4755 _mkdir: making request 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 choose_target_mds inode dir hash is 2 on AlternateNameMkdir_43224 => 2703065264 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 choose_target_mds 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) is_hash=1 hash=2703065264 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 10 client.4755 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 mds is 0 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 10 client.4755 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 encode_cap_releases enter (req: 0x55fa3adf3f40, mds: 0) 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 encode_dentry_release enter(dn:0x7f515c003d30) 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b4b0), req:0x55fa3adf3f40 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 send_request set sent_stamp to 2024-04-25T10:35:23.859788+0000 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 10 client.4755 send_request client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameMkdir_43224 (foo) 2024-04-25T10:35:23.859769+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.934 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameMkdir_43224 (foo) 2024-04-25T10:35:23.859769+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf43f0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.859+0000 7f518d909480 20 client.4755 awaiting reply|forward|kick on 0x7ffc16ba7960 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 830+0+0 (crc 0 0 0) 0x7f51800624a0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 insert_trace from 2024-04-25T10:35:23.859788+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 features 0xffffffffffffffff 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 update_snap_trace len 70 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref was 1 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref now is 2 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 hrm is_target=1 is_dentry=1 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00ba90) - ctime 2024-04-25T10:35:23.859769+0000 mtime 2024-04-25T10:35:23.859769+0000 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 dir hash is 2 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 12 client.4755 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:23.935 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 12 client.4755 add_update_inode adding 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=- 0x7f515c00ba90) caps pAsxLsXsxFsx 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref was 2 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref now is 3 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 15 client.4755 add_update_cap first one, opened snaprealm 0x7f515c00b3c0 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 add_update_cap issued - -> pAsxLsXsxFsx from mds.0 on 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f515c00ba90) 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f515c00ba90) 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 12 client.4755 add_update_inode had 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) caps pAsLsXs 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.846950+0000 ctime=2024-04-25T10:35:23.846950+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) pAsLsXs ctime 2024-04-25T10:35:23.859769+0000 mtime 2024-04-25T10:35:23.859769+0000 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 dir hash is 2 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 12 client.4755 add_update_inode client inode change_attr: 17 , mds inodestat change_attr: 18 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 12 client.4755 insert_dentry_inode 'AlternateNameMkdir_43224' vino 0x10000000009.head in dir 0x1.head dn 0x7f515c003d30 2024-04-25T10:35:23.936 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 15 client.4755 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 'AlternateNameMkdir_43224' to inode 0x7f515c00ba90 dn 0x1.head["AlternateNameMkdir_43224"] (old dn) 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 link inode 0x7f515c00ba90 parents now 0x1.head["AlternateNameMkdir_43224"] 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 15 client.4755 update_dentry_lease 0x1.head["AlternateNameMkdir_43224"] lease(mask 7 dur 30000 altn foo)) from 2024-04-25T10:35:23.859788+0000 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 10 client.4755 got dentry lease on AlternateNameMkdir_43224 dur 30000ms ttl 2024-04-25T10:35:53.859788+0000 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 put_snap_realm 0x1 0x7f515c00b3c0 3 -> 2 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 handle_client_reply signalling caller 0x7ffc16ba7960 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 handle_client_reply awaiting kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 sendrecv kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 lat 0.002640 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 10 client.4755 _mkdir result is 0 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 trim_cache size 1 max 16384 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 8 client.4755 _mkdir(#0x1/AlternateNameMkdir_43224, 040777) = 0 2024-04-25T10:35:23.937 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 10 client.4755 walk: AlternateNameMkdir_43224 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f5185bd0640 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 path_walk cur=0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 10 client.4755 path_walk AlternateNameMkdir_43224 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 10 client.4755 0 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) AlternateNameMkdir_43224 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 (path is AlternateNameMkdir_43224) 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 may_lookup 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 10 client.4755 _getattr mask As issued=1 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 3 client.4755 may_lookup 0x7f515c00b4b0 = 0 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 _lookup have 0x1.head["AlternateNameMkdir_43224"] from mds.0 ttl 2024-04-25T10:35:53.859788+0000 seq 2 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 10 client.4755 _lookup 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) AlternateNameMkdir_43224 = 0x10000000009.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) 2024-04-25T10:35:23.938 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.861+0000 7f518d909480 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 10 client.4755 path_walk 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 may_delete 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0); ; name AlternateNameMkdir_43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 10 client.4755 _getattr mask As issued=1 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 3 client.4755 may_delete 0x7f515c00b4b0 = 0 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 8 client.4755 _rmdir(0x1 AlternateNameMkdir_43224 uid 0 gid 0) 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 get_or_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) name AlternateNameMkdir_43224 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 _lookup have 0x1.head["AlternateNameMkdir_43224"] from mds.0 ttl 2024-04-25T10:35:53.859788+0000 seq 2 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 10 client.4755 _lookup 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) AlternateNameMkdir_43224 = 0x10000000009.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 choose_target_mds inode dir hash is 2 on AlternateNameMkdir_43224 => 2703065264 2024-04-25T10:35:23.939 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 choose_target_mds 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) is_hash=1 hash=2703065264 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 10 client.4755 choose_target_mds from dirfragtree hash 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 mds is 0 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 10 client.4755 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 encode_cap_releases enter (req: 0x55fa3adf43f0, mds: 0) 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 encode_inode_release enter(in:0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90), req:0x55fa3adf43f0 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 encode_dentry_release enter(dn:0x7f515c003d30) 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0), req:0x55fa3adf43f0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 send_request set sent_stamp to 2024-04-25T10:35:23.862549+0000 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 10 client.4755 send_request client_request(unknown.0:3 rmdir #0x1/AlternateNameMkdir_43224 2024-04-25T10:35:23.862527+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 rmdir #0x1/AlternateNameMkdir_43224 2024-04-25T10:35:23.862527+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf47b0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f518d909480 20 client.4755 awaiting reply|forward|kick on 0x7ffc16ba7a30 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_caps(revoke ino 0x10000000009 1 seq 2 caps=pAsXsFsx dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.859769+0000 ctime 2024-04-25T10:35:23.859769+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f5180062690 con 0x55fa3aeb2d70 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 5 client.4755 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:23.940 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 mds.0 seq now 1 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 5 client.4755 handle_cap_grant on in 0x10000000009 mds.0 seq 2 caps now pAsXsFsx was pAsxXsxFsx 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsxXsxFsx(0=pAsxXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) pAsxXsxFsx ctime 2024-04-25T10:35:23.859769+0000 mtime 2024-04-25T10:35:23.859769+0000 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 revocation of AxXx 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 check_caps on 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) wanted AsLsXsFsx used - issued pAsXsFsx revoking AxXx flags=1 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 cap mds.0 issued pAsXsFsx implemented pAsxXsxFsx revoking AxXx 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 completed revocation of AxXx 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 send_cap 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) mds.0 seq 2 used - want AsLsXsFsx flush - retain pAsLsXsFsx held pAsxXsxFsx revoking AxXx dropping - 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 15 client.4755 auth cap, requesting max_size 0 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000009 1 seq 2 caps=pAsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.859769+0000 ctime 2024-04-25T10:35:23.859769+0000 change_attr 0) -- 0x7f515c00c070 con 0x55fa3aeb2d70 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(revoke ino 0x10000000009 1 seq 3 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.859769+0000 ctime 2024-04-25T10:35:23.859769+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f515c00c070 con 0x55fa3aeb2d70 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 mds.0 seq now 2 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 5 client.4755 handle_cap_grant on in 0x10000000009 mds.0 seq 3 caps now pAsXsFs was pAsXsFsx 2024-04-25T10:35:23.941 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) pAsXsFsx ctime 2024-04-25T10:35:23.859769+0000 mtime 2024-04-25T10:35:23.859769+0000 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 revocation of Fx 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 check_caps on 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) wanted AsLsXsFsx used - issued pAsXsFs revoking Fx flags=1 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 cap mds.0 issued pAsXsFs implemented pAsXsFsx revoking Fx 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 completed revocation of Fx 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 send_cap 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) mds.0 seq 3 used - want AsLsXsFsx flush - retain pAsLsXsFs held pAsXsFsx revoking Fx dropping - 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 15 client.4755 auth cap, requesting max_size 0 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000009 1 seq 3 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.859769+0000 ctime 2024-04-25T10:35:23.859769+0000 change_attr 0) -- 0x7f5180062690 con 0x55fa3aeb2d70 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_caps(grant ino 0x10000000009 1 seq 4 caps=pAsLsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.859769+0000 ctime 2024-04-25T10:35:23.859769+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f5180062690 con 0x55fa3aeb2d70 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 mds.0 seq now 3 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 5 client.4755 handle_cap_grant on in 0x10000000009 mds.0 seq 4 caps now pAsLsXsFs was pAsXsFs 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) pAsXsFs ctime 2024-04-25T10:35:23.859769+0000 mtime 2024-04-25T10:35:23.859769+0000 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 grant, new caps are Ls 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.862+0000 7f5185bd0640 10 client.4755 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.942 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(revoke ino 0x10000000009 1 seq 5 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.859769+0000 ctime 2024-04-25T10:35:23.859769+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f518005e040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 mds.0 seq now 4 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 5 client.4755 handle_cap_grant on in 0x10000000009 mds.0 seq 5 caps now pAsXsFs was pAsLsXsFs 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) pAsLsXsFs ctime 2024-04-25T10:35:23.859769+0000 mtime 2024-04-25T10:35:23.859769+0000 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 revocation of Ls 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 check_caps on 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) wanted AsLsXsFsx used - issued pAsXsFs revoking Ls flags=1 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 cap mds.0 issued pAsXsFs implemented pAsLsXsFs revoking Ls 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 completed revocation of Ls 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 send_cap 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_43224"] 0x7f515c00ba90) mds.0 seq 5 used - want AsLsXsFsx flush - retain pAsXsFsx held pAsLsXsFs revoking Ls dropping - 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 15 client.4755 auth cap, requesting max_size 0 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000009 1 seq 5 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.859769+0000 ctime 2024-04-25T10:35:23.859769+0000 change_attr 0) -- 0x7f5180062690 con 0x55fa3aeb2d70 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 496+0+0 (crc 0 0 0) 0x7f518005e3f0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 handle_client_reply got a reply. Safe:0 tid 3 2024-04-25T10:35:23.943 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 insert_trace from 2024-04-25T10:35:23.862549+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 features 0xffffffffffffffff 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 update_snap_trace len 70 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref was 2 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 get_snap_realm 0x1 0x7f515c00b3c0, nref now is 3 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 hrm is_target=0 is_dentry=1 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 12 client.4755 add_update_inode had 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) caps pAsLsXs 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) pAsLsXs ctime 2024-04-25T10:35:23.862527+0000 mtime 2024-04-25T10:35:23.859769+0000 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 dir hash is 2 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 12 client.4755 add_update_inode client inode change_attr: 18 , mds inodestat change_attr: 19 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 15 client.4755 unlink dir 0x7f515c00b4b0 'AlternateNameMkdir_43224' dn 0x7f515c003d30 inode 0x7f515c00ba90 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.944 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 unlink inode 0x7f515c00ba90 parents now 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 15 client.4755 update_dentry_lease 0x1.head["AlternateNameMkdir_43224"] lease(mask 3 dur 30000 altn foo)) from 2024-04-25T10:35:23.862549+0000 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 got dentry lease on AlternateNameMkdir_43224 dur 30000ms ttl 2024-04-25T10:35:53.862549+0000 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 put_snap_realm 0x1 0x7f515c00b3c0 3 -> 2 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 handle_client_reply signalling caller 0x7ffc16ba7a30 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 20 client.4755 handle_client_reply awaiting kickback on tid 3 0x7f5185bcddf0 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 20 client.4755 sendrecv kickback on tid 3 0x7f5185bcddf0 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 20 client.4755 lat 0.001891 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 20 client.4755 trim_cache size 1 max 16384 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 8 client.4755 rmdir(#0x1/AlternateNameMkdir_43224) = 0 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.945 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 2 client.4755 unmount 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 2 client.4755 unmounting 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3adf47b0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_caps(grant ino 0x10000000009 1 seq 6 caps=pAsLsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.859769+0000 ctime 2024-04-25T10:35:23.862527+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f5180062690 con 0x55fa3aeb2d70 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f518d909480 10 client.4755 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 mds.0 seq now 5 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 5 client.4755 handle_cap_grant on in 0x10000000009 mds.0 seq 6 caps now pAsLsXsFsx was pAsXsFs 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.859769+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00ba90) pAsXsFs ctime 2024-04-25T10:35:23.862527+0000 mtime 2024-04-25T10:35:23.859769+0000 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.863+0000 7f5185bd0640 10 client.4755 grant, new caps are LsFx 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.864+0000 7f5185bd0640 10 client.4755 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.864+0000 7f5185bd0640 5 client.4755 _try_to_trim_inode in 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.864+0000 7f5185bd0640 10 client.4755 unmounting: trim pass, size was 1+2 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.864+0000 7f5185bd0640 20 client.4755 trim_cache size 1 max 16384 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.864+0000 7f5185bd0640 10 client.4755 unmounting: trim pass, size still 1+2 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f518005e5e0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.946 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 20 client.4755 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 10 client.4755 insert_trace from 2024-04-25T10:35:23.862549+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 10 client.4755 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 5 client.4755 _try_to_trim_inode in 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 10 client.4755 unmounting: trim pass, size was 1+2 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 20 client.4755 trim_cache size 1 max 16384 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 15 client.4755 trim_dentry unlinking dn AlternateNameMkdir_43224 in dir 0x1 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 15 client.4755 unlink dir 0x7f515c00b4b0 'AlternateNameMkdir_43224' dn 0x7f515c003d30 inode 0 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 15 client.4755 unlink removing 'AlternateNameMkdir_43224' dn 0x7f515c003d30 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 15 client.4755 close_dir dir 0x55fa3ae9f0d0 on 0x7f515c00b4b0 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f5185bd0640 10 client.4755 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:23.947 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _ll_drop_pins 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 _ll_put 0x7f515c00b4b0 0x1 1 -> 0 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 _release 0x10000000009.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _invalidate_inode_cache 0x10000000009.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _flush 0x10000000009.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 nothing to flush 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 _release 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _flush 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 nothing to flush 2024-04-25T10:35:23.948 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_inode on 0x10000000009.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) n = 1 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 1 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 flush_caps_sync 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 trim_cache size 0 max 16384 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) n = 20 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 15 client.4755 remove_cap last one, closing snaprealm 0x7f515c00b3c0 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_snap_realm 0x1 0x7f515c00b3c0 2 -> 1 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=- has_dir_layout 0x7f515c00b4b0) 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _put_inode on 0x10000000009.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) n = 10 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 remove_cap mds.0 on 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00ba90) 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 15 client.4755 remove_cap last one, closing snaprealm 0x7f515c00b3c0 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 20 client.4755 put_snap_realm 0x1 0x7f515c00b3c0 1 -> 0 2024-04-25T10:35:23.949 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 10 client.4755 _put_inode deleting 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.859769+0000 mtime=2024-04-25T10:35:23.859769+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=1 caps=- COMPLETE 0x7f515c00ba90) 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 2 client.4755 _close_mds_session mds.0 seq 5 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 5) -- 0x55fa3aea2c70 con 0x55fa3aeb2d70 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.866+0000 7f518d909480 2 client.4755 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 <== mds.0 v2:172.21.15.103:6834/2389441335 12 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3adf47b0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 10 client.4755 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 5 client.4755 _closed_mds_session mds.0 seq 5 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 1 -- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3adffb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3adffb70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 10 client.4755 remove_session_caps mds.0 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 10 client.4755 kick_requests_closed for mds.0 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 10 client.4755 unmounting: trim pass, size was 0+0 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 20 client.4755 trim_cache size 0 max 16384 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f5185bd0640 10 client.4755 unmounting: trim pass, size still 0+0 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 2 client.4755 unmounted. 2024-04-25T10:35:23.950 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 client.4755 shutdown 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f517c032040 tx=0x55fa3ae03f70 comp rx=0 tx=0).stop 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 shutdown_connections 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3adffb70 unknown :-1 s=CLOSED pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 --2- 172.21.15.103:0/940477062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3ae9eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 >> 172.21.15.103:0/940477062 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 shutdown_connections 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 1 -- 172.21.15.103:0/940477062 wait complete. 2024-04-25T10:35:23.951 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.868+0000 7f518d909480 20 client.4755 trim_cache size 0 max 16384 2024-04-25T10:35:23.952 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameMkdir (15 ms) 2024-04-25T10:35:23.952 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameLong 2024-04-25T10:35:23.963 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.869+0000 7f518d909480 1 -- start start 2024-04-25T10:35:23.963 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:23.963 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.963 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.963 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aea67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.963 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c004910 con 0x55fa3ad801c0 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad7f540 con 0x55fa3aea3cc0 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3aea4800 con 0x55fa3aea62c0 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50602/0 (socket says 172.21.15.103:50602) 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f51873d3640 1 -- 172.21.15.103:0/2891003135 learned_addr learned my addr 172.21.15.103:0/2891003135 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.870+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aea67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51873d3640 1 -- 172.21.15.103:0/2891003135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 msgr2=0x55fa3aea67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51873d3640 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aea67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51873d3640 1 -- 172.21.15.103:0/2891003135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51873d3640 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51873d3640 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aeb99b0 con 0x55fa3ad801c0 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51873d3640 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7add0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5180021460 tx=0x7f51800a1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f52e4c43908fc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:23.964 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180093070 con 0x55fa3ad801c0 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f5180062020 con 0x55fa3ad801c0 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 10 client.4758 Subscribing to map 'mdsmap' 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ad7a600 con 0x55fa3ad801c0 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51767fc640 20 client.4758 tick 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51767fc640 20 client.4758 collect_and_send_metrics 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51767fc640 20 client.4758 collect_and_send_global_metrics 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51767fc640 5 client.4758 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51767fc640 20 client.4758 trim_cache size 0 max 16384 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f51767fc640 20 client.4758 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3ae9f240 con 0x55fa3ad801c0 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066030 con 0x55fa3ad801c0 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f5184bce640 1 client.4758 handle_mds_map epoch 6 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 20 client.4758 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:23.965 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 10 client.4758 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 20 client.4758 mds is 0 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 10 client.4758 _open_mds_session mds.0 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3aea2440 con 0x55fa3aeb2d70 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f518d909480 10 client.4758 waiting for session to mds.0 to open 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.871+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.872+0000 7f5184bce640 10 client.4758 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.872+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70de2b955087d5bc server_cookie=47f67f097043e5a9 in_seq=0 out_seq=0 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3aea2440 con 0x55fa3aeb2d70 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 renew_caps mds.0 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b4b0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 connect_mds_targets for mds.0 2024-04-25T10:35:23.966 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 mds is 0 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 encode_cap_releases enter (req: 0x55fa3ae9ed70, mds: 0) 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 send_request set sent_stamp to 2024-04-25T10:35:23.874748+0000 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.872295+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.872295+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae04a40 con 0x55fa3aeb2d70 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b4b0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c036070 con 0x55fa3aeb2d70 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 insert_trace from 2024-04-25T10:35:23.874748+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 features 0xffffffffffffffff 2024-04-25T10:35:23.967 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 update_snap_trace len 70 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref now is 1 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 15 client.4758 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 15 client.4758 snapc 1=[] 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 put_snap_realm 0x1 0x7f515c00b6d0 2 -> 1 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 hrm is_target=1 is_dentry=0 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b7c0) - ctime 2024-04-25T10:35:23.862527+0000 mtime 2024-04-25T10:35:23.862527+0000 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 dir hash is 2 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 12 client.4758 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 19 2024-04-25T10:35:23.968 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 12 client.4758 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=- has_dir_layout 0x7f515c00b7c0) caps pAsLsXsFs 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref was 1 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref now is 2 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 15 client.4758 add_update_cap first one, opened snaprealm 0x7f515c00b6d0 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 10 client.4758 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 put_snap_realm 0x1 0x7f515c00b6d0 2 -> 1 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 lat 0.000392 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 _ll_get 0x7f515c00b7c0 0x1 -> 1 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 mkdirat: AlternateNameLong_43224 2024-04-25T10:35:23.969 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f5184bce640 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 path_walk 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 may_create 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 _getattr mask As issued=1 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 3 client.4758 may_create 0x7f515c00b7c0 = 0 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 8 client.4758 _mkdir(0x1 AlternateNameLong_43224, 0777, uid 0, gid 0) 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 get_or_create 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) name AlternateNameLong_43224 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 15 open_dir 0x55fa3ad7f620 on 0x7f515c00b7c0 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 15 client.4758 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 'AlternateNameLong_43224' dn 0x1.head["AlternateNameLong_43224"] (new dn) 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 _mkdir: making request 2024-04-25T10:35:23.970 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 choose_target_mds inode dir hash is 2 on AlternateNameLong_43224 => 2801821960 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 choose_target_mds 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) is_hash=1 hash=2801821960 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 mds is 0 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 encode_cap_releases enter (req: 0x55fa3ae049f0, mds: 0) 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 encode_dentry_release enter(dn:0x7f515c00b3c0) 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0), req:0x55fa3ae049f0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 send_request set sent_stamp to 2024-04-25T10:35:23.875231+0000 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 10 client.4758 send_request client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameLong_43224 (--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------) 2024-04-25T10:35:23.875211+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameLong_43224 (--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------) 2024-04-25T10:35:23.875211+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae04db0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.874+0000 7f518d909480 20 client.4758 awaiting reply|forward|kick on 0x7ffc16ba7940 2024-04-25T10:35:23.971 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = 0 (0) Success safe) ==== 5946+0+0 (crc 0 0 0) 0x7f517c018e00 con 0x55fa3aeb2d70 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 insert_trace from 2024-04-25T10:35:23.875231+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 features 0xffffffffffffffff 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 update_snap_trace len 70 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref was 1 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref now is 2 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 hrm is_target=1 is_dentry=1 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00d1b0) - ctime 2024-04-25T10:35:23.875211+0000 mtime 2024-04-25T10:35:23.875211+0000 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 dir hash is 2 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 12 client.4758 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 12 client.4758 add_update_inode adding 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=- 0x7f515c00d1b0) caps pAsxLsXsxFsx 2024-04-25T10:35:23.972 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref was 2 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref now is 3 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 15 client.4758 add_update_cap first one, opened snaprealm 0x7f515c00b6d0 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 add_update_cap issued - -> pAsxLsXsxFsx from mds.0 on 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f515c00d1b0) 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 add_update_cap calling signal_caps_inode 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f515c00d1b0) 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 12 client.4758 add_update_inode had 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) caps pAsLsXs 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.862527+0000 ctime=2024-04-25T10:35:23.862527+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) pAsLsXs ctime 2024-04-25T10:35:23.875211+0000 mtime 2024-04-25T10:35:23.875211+0000 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 dir hash is 2 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 12 client.4758 add_update_inode client inode change_attr: 19 , mds inodestat change_attr: 20 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 12 client.4758 insert_dentry_inode 'AlternateNameLong_43224' vino 0x1000000000a.head in dir 0x1.head dn 0x7f515c00b3c0 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 15 client.4758 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 'AlternateNameLong_43224' to inode 0x7f515c00d1b0 dn 0x1.head["AlternateNameLong_43224"] (old dn) 2024-04-25T10:35:23.973 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 link inode 0x7f515c00d1b0 parents now 0x1.head["AlternateNameLong_43224"] 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 15 client.4758 update_dentry_lease 0x1.head["AlternateNameLong_43224"] lease(mask 7 dur 30000 altn -----------------------------------------------------------------------------------------------------------------------------...)) from 2024-04-25T10:35:23.875231+0000 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 got dentry lease on AlternateNameLong_43224 dur 30000ms ttl 2024-04-25T10:35:53.875231+0000 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 put_snap_realm 0x1 0x7f515c00b6d0 3 -> 2 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 handle_client_reply signalling caller 0x7ffc16ba7940 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 lat 0.002547 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 _mkdir result is 0 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 trim_cache size 1 max 16384 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 8 client.4758 _mkdir(#0x1/AlternateNameLong_43224, 040777) = 0 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.974 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 walk: AlternateNameLong_43224 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 path_walk cur=0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 path_walk AlternateNameLong_43224 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 0 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) AlternateNameLong_43224 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 (path is AlternateNameLong_43224) 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 may_lookup 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 _getattr mask As issued=1 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 3 client.4758 may_lookup 0x7f515c00b7c0 = 0 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 _lookup have 0x1.head["AlternateNameLong_43224"] from mds.0 ttl 2024-04-25T10:35:53.875231+0000 seq 2 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 _lookup 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) AlternateNameLong_43224 = 0x1000000000a.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.975 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 path_walk 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 may_delete 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0); ; name AlternateNameLong_43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 _getattr mask As issued=1 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 3 client.4758 may_delete 0x7f515c00b7c0 = 0 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 8 client.4758 _rmdir(0x1 AlternateNameLong_43224 uid 0 gid 0) 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 get_or_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) name AlternateNameLong_43224 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 _lookup have 0x1.head["AlternateNameLong_43224"] from mds.0 ttl 2024-04-25T10:35:53.875231+0000 seq 2 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 _lookup 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) AlternateNameLong_43224 = 0x1000000000a.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 choose_target_mds inode dir hash is 2 on AlternateNameLong_43224 => 2801821960 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 choose_target_mds 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) is_hash=1 hash=2801821960 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 choose_target_mds from dirfragtree hash 2024-04-25T10:35:23.976 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 mds is 0 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 encode_cap_releases enter (req: 0x55fa3ae04db0, mds: 0) 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 encode_inode_release enter(in:0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0), req:0x55fa3ae04db0 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 encode_dentry_release enter(dn:0x7f515c00b3c0) 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0), req:0x55fa3ae04db0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 send_request set sent_stamp to 2024-04-25T10:35:23.877902+0000 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 10 client.4758 send_request client_request(unknown.0:3 rmdir #0x1/AlternateNameLong_43224 2024-04-25T10:35:23.877880+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 rmdir #0x1/AlternateNameLong_43224 2024-04-25T10:35:23.877880+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad78e90 con 0x55fa3aeb2d70 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f518d909480 20 client.4758 awaiting reply|forward|kick on 0x7ffc16ba7a10 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_caps(revoke ino 0x1000000000a 1 seq 2 caps=pAsXsFsx dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.875211+0000 ctime 2024-04-25T10:35:23.875211+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c064040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 5 client.4758 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 mds.0 seq now 1 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 5 client.4758 handle_cap_grant on in 0x1000000000a mds.0 seq 2 caps now pAsXsFsx was pAsxXsxFsx 2024-04-25T10:35:23.977 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsxXsxFsx(0=pAsxXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) pAsxXsxFsx ctime 2024-04-25T10:35:23.875211+0000 mtime 2024-04-25T10:35:23.875211+0000 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 revocation of AxXx 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 check_caps on 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) wanted AsLsXsFsx used - issued pAsXsFsx revoking AxXx flags=1 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 cap mds.0 issued pAsXsFsx implemented pAsxXsxFsx revoking AxXx 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 completed revocation of AxXx 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 send_cap 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) mds.0 seq 2 used - want AsLsXsFsx flush - retain pAsLsXsFsx held pAsxXsxFsx revoking AxXx dropping - 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 15 client.4758 auth cap, requesting max_size 0 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x1000000000a 1 seq 2 caps=pAsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.875211+0000 ctime 2024-04-25T10:35:23.875211+0000 change_attr 0) -- 0x7f515c00d790 con 0x55fa3aeb2d70 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 10 client.4758 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.877+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(revoke ino 0x1000000000a 1 seq 3 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.875211+0000 ctime 2024-04-25T10:35:23.875211+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f515c00d790 con 0x55fa3aeb2d70 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 mds.0 seq now 2 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 5 client.4758 handle_cap_grant on in 0x1000000000a mds.0 seq 3 caps now pAsXsFs was pAsXsFsx 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) pAsXsFsx ctime 2024-04-25T10:35:23.875211+0000 mtime 2024-04-25T10:35:23.875211+0000 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 revocation of Fx 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 check_caps on 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) wanted AsLsXsFsx used - issued pAsXsFs revoking Fx flags=1 2024-04-25T10:35:23.978 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 cap mds.0 issued pAsXsFs implemented pAsXsFsx revoking Fx 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 completed revocation of Fx 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 send_cap 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) mds.0 seq 3 used - want AsLsXsFsx flush - retain pAsLsXsFs held pAsXsFsx revoking Fx dropping - 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 15 client.4758 auth cap, requesting max_size 0 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x1000000000a 1 seq 3 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.875211+0000 ctime 2024-04-25T10:35:23.875211+0000 change_attr 0) -- 0x7f517c064040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_caps(grant ino 0x1000000000a 1 seq 4 caps=pAsLsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.875211+0000 ctime 2024-04-25T10:35:23.875211+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c064040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 mds.0 seq now 3 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 5 client.4758 handle_cap_grant on in 0x1000000000a mds.0 seq 4 caps now pAsLsXsFs was pAsXsFs 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) pAsXsFs ctime 2024-04-25T10:35:23.875211+0000 mtime 2024-04-25T10:35:23.875211+0000 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 grant, new caps are Ls 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(revoke ino 0x1000000000a 1 seq 5 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.875211+0000 ctime 2024-04-25T10:35:23.875211+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c009950 con 0x55fa3aeb2d70 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 mds.0 seq now 4 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 5 client.4758 handle_cap_grant on in 0x1000000000a mds.0 seq 5 caps now pAsXsFs was pAsLsXsFs 2024-04-25T10:35:23.979 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) pAsLsXsFs ctime 2024-04-25T10:35:23.875211+0000 mtime 2024-04-25T10:35:23.875211+0000 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 revocation of Ls 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 check_caps on 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) wanted AsLsXsFsx used - issued pAsXsFs revoking Ls flags=1 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 cap mds.0 issued pAsXsFs implemented pAsLsXsFs revoking Ls 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 completed revocation of Ls 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 send_cap 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_43224"] 0x7f515c00d1b0) mds.0 seq 5 used - want AsLsXsFsx flush - retain pAsXsFsx held pAsLsXsFs revoking Ls dropping - 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 15 client.4758 auth cap, requesting max_size 0 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x1000000000a 1 seq 5 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.875211+0000 ctime 2024-04-25T10:35:23.875211+0000 change_attr 0) -- 0x7f517c064040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.878+0000 7f5184bce640 10 client.4758 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_reply(???:3 = 0 (0) Success unsafe) ==== 5612+0+0 (crc 0 0 0) 0x7f517c009cb0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 handle_client_reply got a reply. Safe:0 tid 3 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 insert_trace from 2024-04-25T10:35:23.877902+0000 mds.0 is_target=0 is_dentry=1 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 features 0xffffffffffffffff 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 update_snap_trace len 70 2024-04-25T10:35:23.980 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref was 2 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 get_snap_realm 0x1 0x7f515c00b6d0, nref now is 3 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 hrm is_target=0 is_dentry=1 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 12 client.4758 add_update_inode had 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) caps pAsLsXs 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) pAsLsXs ctime 2024-04-25T10:35:23.877880+0000 mtime 2024-04-25T10:35:23.875211+0000 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 dir hash is 2 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 12 client.4758 add_update_inode client inode change_attr: 20 , mds inodestat change_attr: 21 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 15 client.4758 unlink dir 0x7f515c00b7c0 'AlternateNameLong_43224' dn 0x7f515c00b3c0 inode 0x7f515c00d1b0 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 unlink inode 0x7f515c00d1b0 parents now 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 15 client.4758 update_dentry_lease 0x1.head["AlternateNameLong_43224"] lease(mask 3 dur 30000 altn -----------------------------------------------------------------------------------------------------------------------------...)) from 2024-04-25T10:35:23.877902+0000 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 got dentry lease on AlternateNameLong_43224 dur 30000ms ttl 2024-04-25T10:35:53.877902+0000 2024-04-25T10:35:23.981 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 put_snap_realm 0x1 0x7f515c00b6d0 3 -> 2 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 handle_client_reply signalling caller 0x7ffc16ba7a10 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 20 client.4758 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 20 client.4758 lat 0.001859 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 20 client.4758 trim_cache size 1 max 16384 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 8 client.4758 rmdir(#0x1/AlternateNameLong_43224) = 0 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 2 client.4758 unmount 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 2 client.4758 unmounting 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3ad79330 con 0x55fa3aeb2d70 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f518d909480 10 client.4758 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:23.982 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_caps(grant ino 0x1000000000a 1 seq 6 caps=pAsLsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.875211+0000 ctime 2024-04-25T10:35:23.877880+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f517c064040 con 0x55fa3aeb2d70 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 mds.0 seq now 5 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 5 client.4758 handle_cap_grant on in 0x1000000000a mds.0 seq 6 caps now pAsLsXsFsx was pAsXsFs 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.875211+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f515c00d1b0) pAsXsFs ctime 2024-04-25T10:35:23.877880+0000 mtime 2024-04-25T10:35:23.875211+0000 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 grant, new caps are LsFx 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 5 client.4758 _try_to_trim_inode in 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 unmounting: trim pass, size was 1+2 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 20 client.4758 trim_cache size 1 max 16384 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.879+0000 7f5184bce640 10 client.4758 unmounting: trim pass, size still 1+2 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_reply(???:3 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f517c0305c0 con 0x55fa3aeb2d70 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 20 client.4758 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 10 client.4758 insert_trace from 2024-04-25T10:35:23.877902+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 10 client.4758 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.983 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 5 client.4758 _try_to_trim_inode in 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 10 client.4758 unmounting: trim pass, size was 1+2 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 20 client.4758 trim_cache size 1 max 16384 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 15 client.4758 trim_dentry unlinking dn AlternateNameLong_43224 in dir 0x1 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 15 client.4758 unlink dir 0x7f515c00b7c0 'AlternateNameLong_43224' dn 0x7f515c00b3c0 inode 0 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 15 client.4758 unlink removing 'AlternateNameLong_43224' dn 0x7f515c00b3c0 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 15 client.4758 close_dir dir 0x55fa3ad7f620 on 0x7f515c00b7c0 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f5184bce640 10 client.4758 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _ll_drop_pins 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 _ll_put 0x7f515c00b7c0 0x1 1 -> 0 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.984 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 _release 0x1000000000a.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _invalidate_inode_cache 0x1000000000a.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _flush 0x1000000000a.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 nothing to flush 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 _release 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _flush 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 nothing to flush 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_inode on 0x1000000000a.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) n = 1 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 flush_caps_sync 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-04-25T10:35:23.985 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 trim_cache size 0 max 16384 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 20 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 15 client.4758 remove_cap last one, closing snaprealm 0x7f515c00b6d0 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_snap_realm 0x1 0x7f515c00b6d0 2 -> 1 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=- has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _put_inode on 0x1000000000a.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) n = 10 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 remove_cap mds.0 on 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f515c00d1b0) 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 15 client.4758 remove_cap last one, closing snaprealm 0x7f515c00b6d0 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 20 client.4758 put_snap_realm 0x1 0x7f515c00b6d0 1 -> 0 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 10 client.4758 _put_inode deleting 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-04-25T10:35:23.875211+0000 mtime=2024-04-25T10:35:23.875211+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=1 caps=- COMPLETE 0x7f515c00d1b0) 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 2 client.4758 _close_mds_session mds.0 seq 5 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 5) -- 0x55fa3ad79700 con 0x55fa3aeb2d70 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.881+0000 7f518d909480 2 client.4758 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:23.986 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 <== mds.0 v2:172.21.15.103:6834/2389441335 12 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ad79330 con 0x55fa3aeb2d70 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 10 client.4758 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 5 client.4758 _closed_mds_session mds.0 seq 5 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 1 -- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3aea1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 10 client.4758 remove_session_caps mds.0 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 10 client.4758 kick_requests_closed for mds.0 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 10 client.4758 unmounting: trim pass, size was 0+0 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 20 client.4758 trim_cache size 0 max 16384 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f5184bce640 10 client.4758 unmounting: trim pass, size still 0+0 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f518d909480 2 client.4758 unmounted. 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f518d909480 1 client.4758 shutdown 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3ad7add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.883+0000 7f518d909480 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7add0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5180021460 tx=0x7f51800a1000 comp rx=0 tx=0).stop 2024-04-25T10:35:23.987 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 shutdown_connections 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 unknown :-1 s=CLOSED pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea62c0 0x55fa3aea67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aea3cc0 0x55fa3aeb8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 --2- 172.21.15.103:0/2891003135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad801c0 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 >> 172.21.15.103:0/2891003135 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 shutdown_connections 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 -- 172.21.15.103:0/2891003135 wait complete. 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 20 client.4758 trim_cache size 0 max 16384 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameLong (15 ms) 2024-04-25T10:35:23.988 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameCreat 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.884+0000 7f518d909480 1 -- start start 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.885+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.885+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.885+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.885+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.885+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c00a2f0 con 0x55fa3aea62c0 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.885+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad4ba00 con 0x55fa3ad801c0 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.885+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ae04170 con 0x55fa3aea3cc0 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50614/0 (socket says 172.21.15.103:50614) 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 -- 172.21.15.103:0/4009055597 learned_addr learned my addr 172.21.15.103:0/4009055597 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f51873d3640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.003 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 -- 172.21.15.103:0/4009055597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 msgr2=0x55fa3aea67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aea3cc0 0x55fa3aea67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 -- 172.21.15.103:0/4009055597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad801c0 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae0cce0 con 0x55fa3aea62c0 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5187bd4640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5178012a10 tx=0x7f517803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f935c45e8d1d675 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178055070 con 0x55fa3aea62c0 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f5178024850 con 0x55fa3aea62c0 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f518d909480 10 client.4761 Subscribing to map 'mdsmap' 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae9f9a0 con 0x55fa3aea62c0 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5175ffb640 20 client.4761 tick 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5175ffb640 20 client.4761 collect_and_send_metrics 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5175ffb640 20 client.4761 collect_and_send_global_metrics 2024-04-25T10:35:24.004 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5175ffb640 5 client.4761 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5175ffb640 20 client.4761 trim_cache size 0 max 16384 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.886+0000 7f5175ffb640 20 client.4761 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178024a50 con 0x55fa3aea62c0 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178046970 con 0x55fa3aea62c0 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f5185bd0640 1 client.4761 handle_mds_map epoch 6 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f518d909480 20 client.4761 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f518d909480 10 client.4761 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f518d909480 20 client.4761 mds is 0 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f518d909480 10 client.4761 _open_mds_session mds.0 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f518d909480 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3aea2440 con 0x55fa3aeb2d70 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f518d909480 10 client.4761 waiting for session to mds.0 to open 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f51873d3640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.005 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f5185bd0640 10 client.4761 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.887+0000 7f51873d3640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36825ffb78ce2c69 server_cookie=74e60d9c0378833f in_seq=0 out_seq=0 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3aea2440 con 0x55fa3aeb2d70 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f5185bd0640 10 client.4761 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f5185bd0640 10 client.4761 renew_caps mds.0 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b080 con 0x55fa3aeb2d70 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f5185bd0640 10 client.4761 connect_mds_targets for mds.0 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f518d909480 10 client.4761 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f518d909480 20 client.4761 mds is 0 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f518d909480 10 client.4761 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:24.006 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f518d909480 20 client.4761 encode_cap_releases enter (req: 0x55fa3ad38280, mds: 0) 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f518d909480 20 client.4761 send_request set sent_stamp to 2024-04-25T10:35:23.892179+0000 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f518d909480 10 client.4761 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.887589+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.887589+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad7c690 con 0x55fa3aeb2d70 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f518d909480 20 client.4761 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b080 con 0x55fa3aeb2d70 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f5185bd0640 10 client.4761 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.891+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180000bc0 con 0x55fa3aeb2d70 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 insert_trace from 2024-04-25T10:35:23.892179+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 features 0xffffffffffffffff 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 update_snap_trace len 70 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 get_snap_realm 0x1 0x7f515c00b310, nref now is 1 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:24.007 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 15 client.4761 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 15 client.4761 snapc 1=[] 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 put_snap_realm 0x1 0x7f515c00b310 2 -> 1 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 hrm is_target=1 is_dentry=0 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b7c0) - ctime 2024-04-25T10:35:23.877880+0000 mtime 2024-04-25T10:35:23.877880+0000 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 dir hash is 2 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 12 client.4761 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 21 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 12 client.4761 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=- has_dir_layout 0x7f515c00b7c0) caps pAsLsXsFs 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 get_snap_realm 0x1 0x7f515c00b310, nref was 1 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 get_snap_realm 0x1 0x7f515c00b310, nref now is 2 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 15 client.4761 add_update_cap first one, opened snaprealm 0x7f515c00b310 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.008 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 put_snap_realm 0x1 0x7f515c00b310 2 -> 1 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 lat 0.000390 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 _ll_get 0x7f515c00b7c0 0x1 -> 1 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 3 client.4761 openat enter(AlternateNameCreat_43224) 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 path_walk AlternateNameCreat_43224 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) AlternateNameCreat_43224 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 (path is AlternateNameCreat_43224) 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 _getattr mask As issued=1 2024-04-25T10:35:24.009 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 3 client.4761 may_lookup 0x7f515c00b7c0 = 0 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 _do_lookup on #0x1/AlternateNameCreat_43224 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 choose_target_mds inode dir hash is 2 on AlternateNameCreat_43224 => 1801195907 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) is_hash=1 hash=1801195907 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 mds is 0 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 encode_cap_releases enter (req: 0x55fa3ad7c690, mds: 0) 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 send_request set sent_stamp to 2024-04-25T10:35:23.892629+0000 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameCreat_43224 2024-04-25T10:35:23.892615+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/AlternateNameCreat_43224 2024-04-25T10:35:23.892615+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad7cae0 con 0x55fa3aeb2d70 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 awaiting reply|forward|kick on 0x7ffc16ba7460 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f5180045be0 con 0x55fa3aeb2d70 2024-04-25T10:35:24.010 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 insert_trace from 2024-04-25T10:35:23.892629+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 10 client.4761 insert_trace -- no trace 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 handle_client_reply signalling caller 0x7ffc16ba7460 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 handle_client_reply awaiting kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 sendrecv kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 lat 0.000211 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 _do_lookup res is -2 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) AlternateNameCreat_43224 = -2 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 path_walk 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.011 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 _getattr mask As issued=1 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 3 client.4761 may_create 0x7f515c00b7c0 = 0 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 8 client.4761 _create(0x1 AlternateNameCreat_43224, 0777) 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) name AlternateNameCreat_43224 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 15 open_dir 0x55fa3ae04f10 on 0x7f515c00b7c0 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 15 client.4761 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 'AlternateNameCreat_43224' dn 0x1.head["AlternateNameCreat_43224"] (new dn) 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 choose_target_mds inode dir hash is 2 on AlternateNameCreat_43224 => 1801195907 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) is_hash=1 hash=1801195907 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 mds is 0 2024-04-25T10:35:24.012 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 encode_cap_releases enter (req: 0x55fa3ad7cae0, mds: 0) 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 encode_dentry_release enter(dn:0x7f515c00b6d0) 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b7c0), req:0x55fa3ad7cae0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 send_request set sent_stamp to 2024-04-25T10:35:23.892911+0000 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 10 client.4761 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameCreat_43224 (foo) 2024-04-25T10:35:23.892892+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameCreat_43224 (foo) 2024-04-25T10:35:23.892892+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9ecf0 con 0x55fa3aeb2d70 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f518d909480 20 client.4761 awaiting reply|forward|kick on 0x7ffc16ba7720 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.892+0000 7f5185bd0640 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 848+0+0 (crc 0 0 0) 0x7f518005e3f0 con 0x55fa3aeb2d70 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 insert_trace from 2024-04-25T10:35:23.892911+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 features 0xffffffffffffffff 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 update_snap_trace len 70 2024-04-25T10:35:24.013 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 get_snap_realm 0x1 0x7f515c00b310, nref was 1 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 get_snap_realm 0x1 0x7f515c00b310, nref now is 2 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 update_inode_file_time 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bda0) - ctime 2024-04-25T10:35:23.892892+0000 mtime 2024-04-25T10:35:23.892892+0000 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 12 client.4761 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 12 client.4761 add_update_inode adding 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=- objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bda0) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 get_snap_realm 0x1 0x7f515c00b310, nref was 2 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 get_snap_realm 0x1 0x7f515c00b310, nref now is 3 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 15 client.4761 add_update_cap first one, opened snaprealm 0x7f515c00b310 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bda0) 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 12 client.4761 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) caps pAsLsXs 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.877880+0000 ctime=2024-04-25T10:35:23.877880+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) pAsLsXs ctime 2024-04-25T10:35:23.892892+0000 mtime 2024-04-25T10:35:23.892892+0000 2024-04-25T10:35:24.014 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 dir hash is 2 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 12 client.4761 add_update_inode client inode change_attr: 21 , mds inodestat change_attr: 22 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 12 client.4761 insert_dentry_inode 'AlternateNameCreat_43224' vino 0x1000000000b.head in dir 0x1.head dn 0x7f515c00b6d0 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 15 client.4761 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 'AlternateNameCreat_43224' to inode 0x7f515c00bda0 dn 0x1.head["AlternateNameCreat_43224"] (old dn) 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 link inode 0x7f515c00bda0 parents now 0x1.head["AlternateNameCreat_43224"] 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 15 client.4761 update_dentry_lease 0x1.head["AlternateNameCreat_43224"] lease(mask 7 dur 30000 altn foo)) from 2024-04-25T10:35:23.892911+0000 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 10 client.4761 got dentry lease on AlternateNameCreat_43224 dur 30000ms ttl 2024-04-25T10:35:53.892911+0000 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 put_snap_realm 0x1 0x7f515c00b310 3 -> 2 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 handle_client_reply signalling caller 0x7ffc16ba7720 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f5185bd0640 20 client.4761 handle_client_reply awaiting kickback on tid 3 0x7f5185bcddf0 2024-04-25T10:35:24.015 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f518d909480 20 client.4761 sendrecv kickback on tid 3 0x7f5185bcddf0 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f518d909480 10 client.4761 delegated_inos: [] 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f518d909480 10 client.4761 make_request created ino 0x1000000000b 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f518d909480 20 client.4761 make_request target is 0x1000000000b.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f518d909480 20 client.4761 lat 0.002565 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f518d909480 10 break_deleg: breaking delegs on 0x1000000000b.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.894+0000 7f518d909480 10 delegations_broken: delegations empty on 0x1000000000b.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 10 client.4761 _create_fh 0x1000000000b mode 2 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 20 client.4761 trim_cache size 1 max 16384 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 8 client.4761 create(#0x1/AlternateNameCreat_43224, 0100777 layout 0 0 0) = 0 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.016 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 3 client.4761 openat exit(AlternateNameCreat_43224) 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 10 client.4761 get_quota_root realm 0x1 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 10 client.4761 get_quota_root 0x1000000000b.head -> 0x1.head 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 10 client.4761 cur file size is 0 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf4360 0x55fa3adf4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- osd_op(unknown.0.0:1 3.29 3:9752f43f:::1000000000b.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ae9f0b0 con 0x55fa3adf4360 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- osd_op(unknown.0.0:2 3.29 3:9752f43f:::1000000000b.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3aebffd0 con 0x55fa3adf4360 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f5185bd0640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f5185bd0640 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf4360 0x55fa3adf4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f5185bd0640 10 client.4761 ms_handle_connect on v2:172.21.15.103:6824/2287324132 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f5186bd2640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf4360 0x55fa3adf4770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=5cf8239b59f44369 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.895+0000 7f5186bd2640 1 -- 172.21.15.103:0/4009055597 <== osd.3 v2:172.21.15.103:6824/2287324132 1 ==== osd_op_reply(1 1000000000b.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3adf4360 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.896+0000 7f5186bd2640 1 -- 172.21.15.103:0/4009055597 <== osd.3 v2:172.21.15.103:6824/2287324132 2 ==== osd_op_reply(2 1000000000b.00000000 [create] v23'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3adf4360 2024-04-25T10:35:24.017 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.896+0000 7f518d909480 10 client.4761 wanted_max_size 0 -> 3 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.896+0000 7f518d909480 10 client.4761 get_caps 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.896+0000 7f518d909480 20 client.4761 clear_suid_sgid 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.896+0000 7f518d909480 10 client.4761 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.896+0000 7f518d909480 5 client.4761 get_cap_ref got first FILE_BUFFER ref on 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.896+0000 7f518d909480 5 client.4761 get_cap_ref got first FILE_CACHE ref on 0x1000000000b.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 mark_caps_dirty 0x1000000000b.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) - -> Fw 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 cap_delay_requeue on 0x1000000000b.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 get_quota_root realm 0x1 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 get_quota_root 0x1000000000b.head -> 0x1.head 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 7 client.4761 wrote to 3, extending file size 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 mark_caps_dirty 0x1000000000b.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) Fw -> Fw 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 cap_delay_requeue on 0x1000000000b.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 3 client.4761 write(10, "...", 3, 0) = 3 2024-04-25T10:35:24.018 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 3 client.4761 close enter(10) 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 8 client.4761 _release_fh 0x55fa3ad7efb0 mode 2 on 0x1000000000b.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 _flush 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- osd_op(unknown.0.0:3 3.29 3:9752f43f:::1000000000b.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ae9e160 con 0x55fa3adf4360 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 check_caps on 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 delaying cap release 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 cap_delay_requeue on 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 _release_fh 0x55fa3ad7efb0 on inode 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) no async_err state 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 3 client.4761 close exit(10) 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 walk: AlternateNameCreat_43224 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.019 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 path_walk AlternateNameCreat_43224 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 0 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) AlternateNameCreat_43224 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 (path is AlternateNameCreat_43224) 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 may_lookup 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 _getattr mask As issued=1 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 3 client.4761 may_lookup 0x7f515c00b7c0 = 0 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 _lookup have 0x1.head["AlternateNameCreat_43224"] from mds.0 ttl 2024-04-25T10:35:53.892911+0000 seq 2 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 _lookup 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) AlternateNameCreat_43224 = 0x1000000000b.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 2 client.4761 unmount 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 2 client.4761 unmounting 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 _ll_drop_pins 2024-04-25T10:35:24.020 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 _ll_put 0x7f515c00b7c0 0x1 1 -> 0 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 _release 0x1000000000b.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 _flush 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 _release 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 _flush 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 nothing to flush 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 flush_caps_sync 2024-04-25T10:35:24.021 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 check_caps on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=3 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 mark_caps_flushing Fw 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 mark_caps_clean 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 send_cap 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) mds.0 seq 1 used Fcb want Fxcb flush Fw retain pFxcb held pAsxLsXsxFsxcrwb revoking - dropping AsxLsXsxFsrw 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 15 client.4761 auth cap, requesting max_size 3 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x1000000000b 1 seq 1 tid 2 caps=pFxcb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.897518+0000 ctime 2024-04-25T10:35:23.897518+0000 change_attr 1) -- 0x55fa3ad77480 con 0x55fa3aeb2d70 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.897+0000 7f518d909480 10 client.4761 waiting on mds.0 tid 2 (want 2) 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.898+0000 7f5186bd2640 1 -- 172.21.15.103:0/4009055597 <== osd.3 v2:172.21.15.103:6824/2287324132 3 ==== osd_op_reply(3 1000000000b.00000000 [write 0~3] v23'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3adf4360 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.898+0000 7f51777fe640 10 client.4761 _flushed 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.898+0000 7f51777fe640 5 client.4761 put_cap_ref dropped last FILE_BUFFER ref on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.898+0000 7f51777fe640 5 client.4761 put_cap_ref dropped last FILE_CACHE ref on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) 2024-04-25T10:35:24.022 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.898+0000 7f51777fe640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 2 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.898+0000 7f51777fe640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.898+0000 7f51777fe640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(flush_ack ino 0x1000000000b 1 seq 1 tid 2 caps=pFxcb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x55fa3ad77480 con 0x55fa3aeb2d70 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 5 client.4761 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 10 client.4761 mds.0 seq now 1 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 5 client.4761 handle_cap_flush_ack mds.0 cleaned Fw on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) with Fw 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 5 client.4761 flushing_caps Fw -> - 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 10 client.4761 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) !flushing 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 10 client.4761 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_43224"] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 10 client.4761 unmounting: trim pass, size was 1+2 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 20 client.4761 trim_cache size 1 max 16384 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 15 client.4761 trim_dentry unlinking dn AlternateNameCreat_43224 in dir 0x1 2024-04-25T10:35:24.023 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 15 client.4761 unlink dir 0x7f515c00b7c0 'AlternateNameCreat_43224' dn 0x7f515c00b6d0 inode 0x7f515c00bda0 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 20 client.4761 unlink inode 0x7f515c00bda0 parents now 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 15 client.4761 unlink removing 'AlternateNameCreat_43224' dn 0x7f515c00b6d0 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 15 client.4761 close_dir dir 0x55fa3ae04f10 on 0x7f515c00b7c0 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 20 client.4761 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 1 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 20 client.4761 put_inode on 0x1000000000b.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bda0) n = 1 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f5185bd0640 10 client.4761 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 10 client.4761 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 20 client.4761 trim_cache size 0 max 16384 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 10 client.4761 _put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) n = 19 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 10 client.4761 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 15 client.4761 remove_cap last one, closing snaprealm 0x7f515c00b310 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 20 client.4761 put_snap_realm 0x1 0x7f515c00b310 2 -> 1 2024-04-25T10:35:24.024 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 10 client.4761 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=- has_dir_layout 0x7f515c00b7c0) 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 10 client.4761 _put_inode on 0x1000000000b.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bda0) n = 15 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 10 client.4761 remove_cap mds.0 on 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bda0) 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 15 client.4761 remove_cap last one, closing snaprealm 0x7f515c00b310 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 20 client.4761 put_snap_realm 0x1 0x7f515c00b310 1 -> 0 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 10 client.4761 _put_inode deleting 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.892892+0000 mtime=2024-04-25T10:35:23.897518+0000 ctime=2024-04-25T10:35:23.897518+0000 change_attr=1 caps=- objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bda0) 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 2 client.4761 _close_mds_session mds.0 seq 1 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 1) -- 0x55fa3aebfb20 con 0x55fa3aeb2d70 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.899+0000 7f518d909480 2 client.4761 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aebfb20 con 0x55fa3aeb2d70 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 10 client.4761 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 5 client.4761 _closed_mds_session mds.0 seq 1 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 1 -- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 msgr2=0x55fa3aea1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.025 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3aeb2d70 0x55fa3aea1f00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 10 client.4761 remove_session_caps mds.0 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 10 client.4761 kick_requests_closed for mds.0 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 10 client.4761 unmounting: trim pass, size was 0+0 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 20 client.4761 trim_cache size 0 max 16384 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5185bd0640 10 client.4761 unmounting: trim pass, size still 0+0 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 2 client.4761 unmounted. 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 client.4761 shutdown 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf4360 msgr2=0x55fa3adf4770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x55fa3adf4360 0x55fa3adf4770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 msgr2=0x55fa3ad7add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 --2- 172.21.15.103:0/4009055597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aea62c0 0x55fa3ad7add0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5178012a10 tx=0x7f517803e000 comp rx=0 tx=0).stop 2024-04-25T10:35:24.026 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f5187bd4640 1 -- 172.21.15.103:0/4009055597 reap_dead start 2024-04-25T10:35:24.027 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 shutdown_connections 2024-04-25T10:35:24.027 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 >> 172.21.15.103:0/4009055597 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad79280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:24.027 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 shutdown_connections 2024-04-25T10:35:24.027 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 1 -- 172.21.15.103:0/4009055597 wait complete. 2024-04-25T10:35:24.027 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.902+0000 7f518d909480 20 client.4761 trim_cache size 0 max 16384 2024-04-25T10:35:24.027 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameCreat (19 ms) 2024-04-25T10:35:24.027 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameSymlink 2024-04-25T10:35:24.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.903+0000 7f518d909480 1 -- start start 2024-04-25T10:35:24.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:24.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb2d70 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae05db0 0x55fa3aea67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.043 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c007940 con 0x55fa3aeb1180 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3adfeb90 con 0x55fa3aeb2d70 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ae055e0 con 0x55fa3ae05db0 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50624/0 (socket says 172.21.15.103:50624) 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 -- 172.21.15.103:0/3345297718 learned_addr learned my addr 172.21.15.103:0/3345297718 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f51873d3640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb2d70 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae05db0 0x55fa3aea67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 -- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae05db0 msgr2=0x55fa3aea67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ae05db0 0x55fa3aea67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 -- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb2d70 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb2d70 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3adf7690 con 0x55fa3aeb1180 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55fa3acf9aa0 tx=0x7f517c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43c3459a834588f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.904+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:24.044 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c04e040 con 0x55fa3aeb1180 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 10 client.4764 Subscribing to map 'mdsmap' 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517c016440 con 0x55fa3aeb1180 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae049f0 con 0x55fa3aeb1180 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f51767fc640 20 client.4764 tick 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f51767fc640 20 client.4764 collect_and_send_metrics 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f51767fc640 20 client.4764 collect_and_send_global_metrics 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f51767fc640 5 client.4764 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f51767fc640 20 client.4764 trim_cache size 0 max 16384 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f51767fc640 20 client.4764 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c07f040 con 0x55fa3aeb1180 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c061040 con 0x55fa3aeb1180 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f5184bce640 1 client.4764 handle_mds_map epoch 6 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 20 client.4764 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 10 client.4764 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.045 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 20 client.4764 mds is 0 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 10 client.4764 _open_mds_session mds.0 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae03b20 0x55fa3ae9db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3adf4af0 con 0x55fa3ae03b20 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f518d909480 10 client.4764 waiting for session to mds.0 to open 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f51873d3640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae03b20 0x55fa3ae9db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.905+0000 7f5184bce640 10 client.4764 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.906+0000 7f51873d3640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae03b20 0x55fa3ae9db80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5727284a3b242d2 server_cookie=2cc9d253b8f837e0 in_seq=0 out_seq=0 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3adf4af0 con 0x55fa3ae03b20 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 renew_caps mds.0 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b6b0 con 0x55fa3ae03b20 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 connect_mds_targets for mds.0 2024-04-25T10:35:24.046 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 mds is 0 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 encode_cap_releases enter (req: 0x55fa3ae9e610, mds: 0) 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 send_request set sent_stamp to 2024-04-25T10:35:23.910607+0000 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.905805+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.905805+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adffb70 con 0x55fa3ae03b20 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b6b0 con 0x55fa3ae03b20 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f5180005a40 con 0x55fa3ae03b20 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 insert_trace from 2024-04-25T10:35:23.910607+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 features 0xffffffffffffffff 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 update_snap_trace len 70 2024-04-25T10:35:24.047 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref now is 1 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 15 client.4764 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 15 client.4764 snapc 1=[] 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 put_snap_realm 0x1 0x7f515c00b8d0 2 -> 1 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 hrm is_target=1 is_dentry=0 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00b9c0) - ctime 2024-04-25T10:35:23.892892+0000 mtime 2024-04-25T10:35:23.892892+0000 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 dir hash is 2 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 12 client.4764 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 22 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 12 client.4764 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=- has_dir_layout 0x7f515c00b9c0) caps pAsLsXsFs 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref was 1 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref now is 2 2024-04-25T10:35:24.048 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 15 client.4764 add_update_cap first one, opened snaprealm 0x7f515c00b8d0 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 put_snap_realm 0x1 0x7f515c00b8d0 2 -> 1 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 lat 0.000387 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 _ll_get 0x7f515c00b9c0 0x1 -> 1 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 3 client.4764 openat enter(AlternateNameSymlink_43224) 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 path_walk AlternateNameSymlink_43224 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) AlternateNameSymlink_43224 2024-04-25T10:35:24.049 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 (path is AlternateNameSymlink_43224) 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 _getattr mask As issued=1 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 3 client.4764 may_lookup 0x7f515c00b9c0 = 0 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 _do_lookup on #0x1/AlternateNameSymlink_43224 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 choose_target_mds inode dir hash is 2 on AlternateNameSymlink_43224 => 2079881453 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) is_hash=1 hash=2079881453 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 mds is 0 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 encode_cap_releases enter (req: 0x55fa3adffb70, mds: 0) 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 send_request set sent_stamp to 2024-04-25T10:35:23.911057+0000 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameSymlink_43224 2024-04-25T10:35:23.911043+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.050 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/AlternateNameSymlink_43224 2024-04-25T10:35:23.911043+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad7e3f0 con 0x55fa3ae03b20 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 awaiting reply|forward|kick on 0x7ffc16ba7630 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f5180045be0 con 0x55fa3ae03b20 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 insert_trace from 2024-04-25T10:35:23.911057+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 10 client.4764 insert_trace -- no trace 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 handle_client_reply signalling caller 0x7ffc16ba7630 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 lat 0.000203 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 _do_lookup res is -2 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) AlternateNameSymlink_43224 = -2 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.051 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 path_walk 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 _getattr mask As issued=1 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 3 client.4764 may_create 0x7f515c00b9c0 = 0 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 8 client.4764 _create(0x1 AlternateNameSymlink_43224, 0777) 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) name AlternateNameSymlink_43224 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 15 open_dir 0x55fa3ae041e0 on 0x7f515c00b9c0 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 15 client.4764 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) 'AlternateNameSymlink_43224' dn 0x1.head["AlternateNameSymlink_43224"] (new dn) 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 choose_target_mds inode dir hash is 2 on AlternateNameSymlink_43224 => 2079881453 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) is_hash=1 hash=2079881453 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.052 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 mds is 0 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 encode_cap_releases enter (req: 0x55fa3ad7e3f0, mds: 0) 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 encode_dentry_release enter(dn:0x7f515c00a5e0) 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00b9c0), req:0x55fa3ad7e3f0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 send_request set sent_stamp to 2024-04-25T10:35:23.911331+0000 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 10 client.4764 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameSymlink_43224 (foo) 2024-04-25T10:35:23.911312+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameSymlink_43224 (foo) 2024-04-25T10:35:23.911312+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aea1f00 con 0x55fa3ae03b20 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f518d909480 20 client.4764 awaiting reply|forward|kick on 0x7ffc16ba78f0 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.910+0000 7f5184bce640 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 850+0+0 (crc 0 0 0) 0x7f5180062040 con 0x55fa3ae03b20 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 insert_trace from 2024-04-25T10:35:23.911331+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 features 0xffffffffffffffff 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 update_snap_trace len 70 2024-04-25T10:35:24.053 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref was 1 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref now is 2 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 update_inode_file_time 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) - ctime 2024-04-25T10:35:23.911312+0000 mtime 2024-04-25T10:35:23.911312+0000 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 12 client.4764 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 12 client.4764 add_update_inode adding 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=- objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref was 2 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref now is 3 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 15 client.4764 add_update_cap first one, opened snaprealm 0x7f515c00b8d0 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) 2024-04-25T10:35:24.054 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 12 client.4764 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) caps pAsLsXs 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.892892+0000 ctime=2024-04-25T10:35:23.892892+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) pAsLsXs ctime 2024-04-25T10:35:23.911312+0000 mtime 2024-04-25T10:35:23.911312+0000 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 dir hash is 2 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 12 client.4764 add_update_inode client inode change_attr: 22 , mds inodestat change_attr: 23 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 12 client.4764 insert_dentry_inode 'AlternateNameSymlink_43224' vino 0x1000000000c.head in dir 0x1.head dn 0x7f515c00a5e0 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 15 client.4764 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 'AlternateNameSymlink_43224' to inode 0x7f515c00bfa0 dn 0x1.head["AlternateNameSymlink_43224"] (old dn) 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 link inode 0x7f515c00bfa0 parents now 0x1.head["AlternateNameSymlink_43224"] 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 15 client.4764 update_dentry_lease 0x1.head["AlternateNameSymlink_43224"] lease(mask 7 dur 30000 altn foo)) from 2024-04-25T10:35:23.911331+0000 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 got dentry lease on AlternateNameSymlink_43224 dur 30000ms ttl 2024-04-25T10:35:53.911331+0000 2024-04-25T10:35:24.055 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 put_snap_realm 0x1 0x7f515c00b8d0 3 -> 2 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 handle_client_reply signalling caller 0x7ffc16ba78f0 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 20 client.4764 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 10 client.4764 delegated_inos: [] 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 10 client.4764 make_request created ino 0x1000000000c 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 20 client.4764 make_request target is 0x1000000000c.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 20 client.4764 lat 0.002474 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 10 break_deleg: breaking delegs on 0x1000000000c.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 10 delegations_broken: delegations empty on 0x1000000000c.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 10 client.4764 _create_fh 0x1000000000c mode 2 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 20 client.4764 trim_cache size 1 max 16384 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 8 client.4764 create(#0x1/AlternateNameSymlink_43224, 0100777 layout 0 0 0) = 0 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.056 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 3 client.4764 openat exit(AlternateNameSymlink_43224) 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 10 client.4764 get_quota_root realm 0x1 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 10 client.4764 get_quota_root 0x1000000000c.head -> 0x1.head 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 10 client.4764 cur file size is 0 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3ad75f40 0x55fa3ad78360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- osd_op(unknown.0.0:1 3.22 3:46cca9ab:::1000000000c.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3adf4740 con 0x55fa3ad75f40 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- osd_op(unknown.0.0:2 3.22 3:46cca9ab:::1000000000c.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3aea22c0 con 0x55fa3ad75f40 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3ad75f40 0x55fa3ad78360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5184bce640 10 client.4764 ms_handle_connect on v2:172.21.15.132:6824/2888495984 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.913+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3ad75f40 0x55fa3ad78360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=f3f9860db5bdb671 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.914+0000 7f5187bd4640 1 -- 172.21.15.103:0/3345297718 <== osd.5 v2:172.21.15.132:6824/2888495984 1 ==== osd_op_reply(1 1000000000c.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ad75f40 2024-04-25T10:35:24.057 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f5187bd4640 1 -- 172.21.15.103:0/3345297718 <== osd.5 v2:172.21.15.132:6824/2888495984 2 ==== osd_op_reply(2 1000000000c.00000000 [create] v23'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ad75f40 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 wanted_max_size 0 -> 3 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 get_caps 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 clear_suid_sgid 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 5 client.4764 get_cap_ref got first FILE_BUFFER ref on 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 5 client.4764 get_cap_ref got first FILE_CACHE ref on 0x1000000000c.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 mark_caps_dirty 0x1000000000c.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) - -> Fw 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 cap_delay_requeue on 0x1000000000c.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 get_quota_root realm 0x1 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 get_quota_root 0x1000000000c.head -> 0x1.head 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 7 client.4764 wrote to 3, extending file size 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 mark_caps_dirty 0x1000000000c.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) Fw -> Fw 2024-04-25T10:35:24.058 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 cap_delay_requeue on 0x1000000000c.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 3 client.4764 write(10, "...", 3, 0) = 3 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 3 client.4764 close enter(10) 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 8 client.4764 _release_fh 0x55fa3ad7efb0 mode 2 on 0x1000000000c.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 _flush 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- osd_op(unknown.0.0:3 3.22 3:46cca9ab:::1000000000c.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3aea22c0 con 0x55fa3ad75f40 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 check_caps on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 delaying cap release 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 cap_delay_requeue on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 _release_fh 0x55fa3ad7efb0 on inode 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) no async_err state 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 3 client.4764 close exit(10) 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 path_walk cur=0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 path_walk 2024-04-25T10:35:24.059 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 may_create 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 _getattr mask As issued=1 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 3 client.4764 may_create 0x7f515c00b9c0 = 0 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 8 client.4764 _symlink(0x1 AlternateNameSymlink_432242, AlternateNameSymlink_43224, uid 0, gid 0) 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 get_or_create 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) name AlternateNameSymlink_432242 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 15 client.4764 link dir 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 'AlternateNameSymlink_432242' dn 0x1.head["AlternateNameSymlink_432242"] (new dn) 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 choose_target_mds inode dir hash is 2 on AlternateNameSymlink_432242 => 3402311093 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 choose_target_mds 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) is_hash=1 hash=3402311093 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 choose_target_mds from dirfragtree hash 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 mds is 0 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 send_request rebuilding request 4 for mds.0 2024-04-25T10:35:24.060 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 encode_cap_releases enter (req: 0x55fa3aea22c0, mds: 0) 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 encode_dentry_release enter(dn:0x55fa3acfd4e0) 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0), req:0x55fa3aea22c0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 send_request set sent_stamp to 2024-04-25T10:35:23.916066+0000 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 10 client.4764 send_request client_request(unknown.0:4 symlink owner_uid=0, owner_gid=0 #0x1/AlternateNameSymlink_432242 (foo2) AlternateNameSymlink_43224 2024-04-25T10:35:23.916049+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:4 symlink owner_uid=0, owner_gid=0 #0x1/AlternateNameSymlink_432242 (foo2) AlternateNameSymlink_43224 2024-04-25T10:35:23.916049+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad788a0 con 0x55fa3ae03b20 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.915+0000 7f518d909480 20 client.4764 awaiting reply|forward|kick on 0x7ffc16ba7b60 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_reply(???:4 = 0 (0) Success unsafe) ==== 860+0+0 (crc 0 0 0) 0x7f518005e3f0 con 0x55fa3ae03b20 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 handle_client_reply got a reply. Safe:0 tid 4 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 insert_trace from 2024-04-25T10:35:23.916066+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 features 0xffffffffffffffff 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 update_snap_trace len 70 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref was 2 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref now is 3 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.061 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 update_inode_file_time 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=120777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00c580) - ctime 2024-04-25T10:35:23.916049+0000 mtime 2024-04-25T10:35:23.916049+0000 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 size 0 -> 26 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 12 client.4764 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 12 client.4764 add_update_inode adding 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=- 0x7f515c00c580) caps pAsLsXsFscr 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref was 3 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 get_snap_realm 0x1 0x7f515c00b8d0, nref now is 4 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 15 client.4764 add_update_cap first one, opened snaprealm 0x7f515c00b8d0 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 add_update_cap issued - -> pAsLsXsFscr from mds.0 on 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 12 client.4764 add_update_inode had 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) caps pAsLsXs 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 update_inode_file_time 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.911312+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) pAsLsXs ctime 2024-04-25T10:35:23.916049+0000 mtime 2024-04-25T10:35:23.911312+0000 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 dir hash is 2 2024-04-25T10:35:24.062 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 12 client.4764 add_update_inode client inode change_attr: 23 , mds inodestat change_attr: 24 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 12 client.4764 insert_dentry_inode 'AlternateNameSymlink_432242' vino 0x1000000000d.head in dir 0x1.head dn 0x55fa3acfd4e0 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 15 client.4764 link dir 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 'AlternateNameSymlink_432242' to inode 0x7f515c00c580 dn 0x1.head["AlternateNameSymlink_432242"] (old dn) 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000d.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_432242"] 0x7f515c00c580) n = 1 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 link inode 0x7f515c00c580 parents now 0x1.head["AlternateNameSymlink_432242"] 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000d.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_432242"] 0x7f515c00c580) n = 1 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 15 client.4764 update_dentry_lease 0x1.head["AlternateNameSymlink_432242"] lease(mask 7 dur 30000 altn foo2)) from 2024-04-25T10:35:23.916066+0000 2024-04-25T10:35:24.063 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 10 client.4764 got dentry lease on AlternateNameSymlink_432242 dur 30000ms ttl 2024-04-25T10:35:53.916066+0000 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 put_snap_realm 0x1 0x7f515c00b8d0 4 -> 3 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 handle_client_reply signalling caller 0x7ffc16ba7b60 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5184bce640 20 client.4764 handle_client_reply awaiting kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 sendrecv kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 lat 0.000661 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 trim_cache size 2 max 16384 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 8 client.4764 _symlink("#0x1/AlternateNameSymlink_432242", "AlternateNameSymlink_43224") = 0 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 walk: AlternateNameSymlink_432242 2024-04-25T10:35:24.064 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 path_walk cur=0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 path_walk AlternateNameSymlink_432242 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 0 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) AlternateNameSymlink_432242 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 (path is AlternateNameSymlink_432242) 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 may_lookup 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 _getattr mask As issued=1 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 3 client.4764 may_lookup 0x7f515c00b9c0 = 0 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 _lookup have 0x1.head["AlternateNameSymlink_432242"] from mds.0 ttl 2024-04-25T10:35:53.916066+0000 seq 3 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 _lookup 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) AlternateNameSymlink_432242 = 0x1000000000d.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_432242"] 0x7f515c00c580) 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 symlink count 1, value is 'AlternateNameSymlink_43224' 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.065 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 walk: AlternateNameSymlink_43224 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 path_walk cur=0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 path_walk AlternateNameSymlink_43224 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 0 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) AlternateNameSymlink_43224 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 (path is AlternateNameSymlink_43224) 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 may_lookup 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 _getattr mask As issued=1 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 3 client.4764 may_lookup 0x7f515c00b9c0 = 0 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 _lookup have 0x1.head["AlternateNameSymlink_43224"] from mds.0 ttl 2024-04-25T10:35:53.911331+0000 seq 2 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 _lookup 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) AlternateNameSymlink_43224 = 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000d.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_432242"] 0x7f515c00c580) n = 1 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.066 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 2 client.4764 unmount 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 2 client.4764 unmounting 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3aea4fa0 con 0x55fa3ae03b20 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f518d909480 10 client.4764 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f5187bd4640 1 -- 172.21.15.103:0/3345297718 <== osd.5 v2:172.21.15.132:6824/2888495984 3 ==== osd_op_reply(3 1000000000c.00000000 [write 0~3] v23'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ad75f40 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f51777fe640 10 client.4764 _flushed 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f51777fe640 5 client.4764 put_cap_ref dropped last FILE_BUFFER ref on 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f51777fe640 5 client.4764 put_cap_ref dropped last FILE_CACHE ref on 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f51777fe640 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 2 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.916+0000 7f51777fe640 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_43224"] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:4 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f518005e5e0 con 0x55fa3ae03b20 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 handle_client_reply got a reply. Safe:1 tid 4 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 10 client.4764 insert_trace from 2024-04-25T10:35:23.916066+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 10 client.4764 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:24.067 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000d.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_432242"] 0x7f515c00c580) n = 1 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 10 client.4764 unmounting: trim pass, size was 2+3 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 trim_cache size 2 max 16384 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 15 client.4764 trim_dentry unlinking dn AlternateNameSymlink_432242 in dir 0x1 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 15 client.4764 unlink dir 0x7f515c00b9c0 'AlternateNameSymlink_432242' dn 0x55fa3acfd4e0 inode 0x7f515c00c580 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000d.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) n = 1 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 unlink inode 0x7f515c00c580 parents now 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 15 client.4764 unlink removing 'AlternateNameSymlink_432242' dn 0x55fa3acfd4e0 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000d.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) n = 1 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 15 client.4764 trim_dentry unlinking dn AlternateNameSymlink_43224 in dir 0x1 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 15 client.4764 unlink dir 0x7f515c00b9c0 'AlternateNameSymlink_43224' dn 0x7f515c00a5e0 inode 0x7f515c00bfa0 2024-04-25T10:35:24.068 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 unlink inode 0x7f515c00bfa0 parents now 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 15 client.4764 unlink removing 'AlternateNameSymlink_43224' dn 0x7f515c00a5e0 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 15 client.4764 close_dir dir 0x55fa3ae041e0 on 0x7f515c00b9c0 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f5184bce640 10 client.4764 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 _ll_drop_pins 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 _ll_put 0x7f515c00b9c0 0x1 1 -> 0 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 _release 0x1000000000d.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) 2024-04-25T10:35:24.069 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 _invalidate_inode_cache 0x1000000000d.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 _flush 0x1000000000d.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 nothing to flush 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000d.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) n = 1 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 _release 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bfa0) 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 _invalidate_inode_cache 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00bfa0) 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 _flush 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 nothing to flush 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 _release 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 _flush 0x1.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 nothing to flush 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.070 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000d.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) n = 1 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 20 client.4764 put_inode on 0x1.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 1 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 flush_caps_sync 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 check_caps on 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=3 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 mark_caps_flushing Fw 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 mark_caps_clean 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 send_cap 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) mds.0 seq 1 used - want - flush Fw retain p held pAsxLsXsxFsxcrwb revoking - dropping AsxLsXsxFsxcrwb 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 15 client.4764 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x1000000000c 1 seq 1 tid 2 caps=p dirty=Fw wanted=- follows 1 size 3/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.915919+0000 ctime 2024-04-25T10:35:23.915919+0000 change_attr 1) -- 0x55fa3adf4290 con 0x55fa3ae03b20 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.918+0000 7f518d909480 10 client.4764 waiting on mds.0 tid 2 (want 2) 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(flush_ack ino 0x1000000000c 1 seq 1 tid 2 caps=p dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x55fa3adf4290 con 0x55fa3ae03b20 2024-04-25T10:35:24.071 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 5 client.4764 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 10 client.4764 mds.0 seq now 1 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 5 client.4764 handle_cap_flush_ack mds.0 cleaned Fw on 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=p(0=p) flushing_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) with Fw 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 5 client.4764 flushing_caps Fw -> - 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 10 client.4764 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=p(0=p) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) !flushing 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 10 client.4764 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 20 client.4764 put_inode on 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=p(0=p) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) n = 1 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 10 client.4764 unmounting: trim pass, size was 0+3 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 20 client.4764 trim_cache size 0 max 16384 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f5184bce640 10 client.4764 unmounting: trim pass, size still 0+3 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 20 client.4764 trim_cache size 0 max 16384 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 _put_inode on 0x1.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) n = 25 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.072 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 15 client.4764 remove_cap last one, closing snaprealm 0x7f515c00b8d0 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 20 client.4764 put_snap_realm 0x1 0x7f515c00b8d0 3 -> 2 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.911312+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=- has_dir_layout 0x7f515c00b9c0) 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 _put_inode on 0x1000000000c.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=p(0=p) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) n = 15 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 remove_cap mds.0 on 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=p(0=p) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 15 client.4764 remove_cap last one, closing snaprealm 0x7f515c00b8d0 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 20 client.4764 put_snap_realm 0x1 0x7f515c00b8d0 2 -> 1 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 _put_inode deleting 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.911312+0000 mtime=2024-04-25T10:35:23.915919+0000 ctime=2024-04-25T10:35:23.915919+0000 change_attr=1 caps=- objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00bfa0) 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 _put_inode on 0x1000000000d.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) n = 8 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 remove_cap mds.0 on 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f515c00c580) 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 15 client.4764 remove_cap last one, closing snaprealm 0x7f515c00b8d0 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 20 client.4764 put_snap_realm 0x1 0x7f515c00b8d0 1 -> 0 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 10 client.4764 _put_inode deleting 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-04-25T10:35:23.916049+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=0 caps=- 0x7f515c00c580) 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 2 client.4764 _close_mds_session mds.0 seq 1 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 1) -- 0x55fa3ad78d40 con 0x55fa3ae03b20 2024-04-25T10:35:24.073 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.920+0000 7f518d909480 2 client.4764 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aea4fa0 con 0x55fa3ae03b20 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 10 client.4764 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 5 client.4764 _closed_mds_session mds.0 seq 1 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 1 -- 172.21.15.103:0/3345297718 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae03b20 msgr2=0x55fa3ae9db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae03b20 0x55fa3ae9db80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 10 client.4764 remove_session_caps mds.0 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 10 client.4764 kick_requests_closed for mds.0 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 10 client.4764 unmounting: trim pass, size was 0+0 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 20 client.4764 trim_cache size 0 max 16384 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5184bce640 10 client.4764 unmounting: trim pass, size still 0+0 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 2 client.4764 unmounted. 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 client.4764 shutdown 2024-04-25T10:35:24.074 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3ad75f40 msgr2=0x55fa3ad78360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x55fa3ad75f40 0x55fa3ad78360 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 --2- 172.21.15.103:0/3345297718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55fa3acf9aa0 tx=0x7f517c01a000 comp rx=0 tx=0).stop 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f5187bd4640 1 -- 172.21.15.103:0/3345297718 reap_dead start 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 shutdown_connections 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 >> 172.21.15.103:0/3345297718 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 shutdown_connections 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 1 -- 172.21.15.103:0/3345297718 wait complete. 2024-04-25T10:35:24.075 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.924+0000 7f518d909480 20 client.4764 trim_cache size 0 max 16384 2024-04-25T10:35:24.076 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameSymlink (22 ms) 2024-04-25T10:35:24.076 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameRename 2024-04-25T10:35:24.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.925+0000 7f518d909480 1 -- start start 2024-04-25T10:35:24.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:24.092 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb2d70 0x55fa3ad38280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4af0 0x55fa3aea67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c006b20 con 0x55fa3aeb2d70 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ad7a000 con 0x55fa3adf4af0 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3adf7170 con 0x55fa3aeb1180 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb2d70 0x55fa3ad38280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb2d70 0x55fa3ad38280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50628/0 (socket says 172.21.15.103:50628) 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f51873d3640 1 -- 172.21.15.103:0/2201767992 learned_addr learned my addr 172.21.15.103:0/2201767992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4af0 0x55fa3aea67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.926+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f51873d3640 1 -- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb1180 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f51873d3640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f51873d3640 1 -- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4af0 msgr2=0x55fa3aea67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f51873d3640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4af0 0x55fa3aea67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.093 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f51873d3640 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aeb99b0 con 0x55fa3aeb2d70 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f51873d3640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb2d70 0x55fa3ad38280 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5180021460 tx=0x55fa3adf7990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05a011888969caa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5185bd0640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800c2080 con 0x55fa3aeb2d70 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f51800620d0 con 0x55fa3aeb2d70 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 10 client.4767 Subscribing to map 'mdsmap' 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3adf3990 con 0x55fa3aeb2d70 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5175ffb640 20 client.4767 tick 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5175ffb640 20 client.4767 collect_and_send_metrics 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5175ffb640 20 client.4767 collect_and_send_global_metrics 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5175ffb640 5 client.4767 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5175ffb640 20 client.4767 trim_cache size 0 max 16384 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5175ffb640 20 client.4767 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fa3ae061f0 con 0x55fa3aeb2d70 2024-04-25T10:35:24.094 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5180066040 con 0x55fa3aeb2d70 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5185bd0640 1 client.4767 handle_mds_map epoch 6 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 20 client.4767 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 10 client.4767 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 20 client.4767 mds is 0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 10 client.4767 _open_mds_session mds.0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7e3f0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ae9fb40 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f518d909480 10 client.4767 waiting for session to mds.0 to open 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.927+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7e3f0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.928+0000 7f5185bd0640 10 client.4767 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.928+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7e3f0 0x55fa3ad7add0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8757275e3858d18a server_cookie=3ca3326489f6c00c in_seq=0 out_seq=0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.929+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ae9fb40 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.929+0000 7f5185bd0640 10 client.4767 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 renew_caps mds.0 2024-04-25T10:35:24.095 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c007d80 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 connect_mds_targets for mds.0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 mds is 0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 encode_cap_releases enter (req: 0x55fa3adffb70, mds: 0) 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 send_request set sent_stamp to 2024-04-25T10:35:23.930519+0000 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.928241+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.928241+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf4370 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c007d80 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f517c036040 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 insert_trace from 2024-04-25T10:35:23.930519+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:24.096 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 features 0xffffffffffffffff 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 update_snap_trace len 70 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref now is 1 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 15 client.4767 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 15 client.4767 snapc 1=[] 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 put_snap_realm 0x1 0x7f515c00b9c0 2 -> 1 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 hrm is_target=1 is_dentry=0 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00bab0) - ctime 2024-04-25T10:35:23.916049+0000 mtime 2024-04-25T10:35:23.916049+0000 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 dir hash is 2 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 12 client.4767 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 24 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 12 client.4767 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=- has_dir_layout 0x7f515c00bab0) caps pAsLsXsFs 2024-04-25T10:35:24.097 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref was 1 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref now is 2 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 15 client.4767 add_update_cap first one, opened snaprealm 0x7f515c00b9c0 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 put_snap_realm 0x1 0x7f515c00b9c0 2 -> 1 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 lat 0.000393 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 _ll_get 0x7f515c00bab0 0x1 -> 1 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 3 client.4767 openat enter(AlternateNameRename_43224) 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.098 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 path_walk AlternateNameRename_43224 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) AlternateNameRename_43224 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 (path is AlternateNameRename_43224) 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 _getattr mask As issued=1 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 3 client.4767 may_lookup 0x7f515c00bab0 = 0 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 _do_lookup on #0x1/AlternateNameRename_43224 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 choose_target_mds inode dir hash is 2 on AlternateNameRename_43224 => 1788968174 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) is_hash=1 hash=1788968174 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 mds is 0 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 encode_cap_releases enter (req: 0x55fa3adf4370, mds: 0) 2024-04-25T10:35:24.099 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 send_request set sent_stamp to 2024-04-25T10:35:23.930978+0000 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameRename_43224 2024-04-25T10:35:23.930962+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/AlternateNameRename_43224 2024-04-25T10:35:23.930962+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad801c0 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 awaiting reply|forward|kick on 0x7ffc16ba7630 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f517c016440 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 insert_trace from 2024-04-25T10:35:23.930978+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 10 client.4767 insert_trace -- no trace 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 handle_client_reply signalling caller 0x7ffc16ba7630 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 handle_client_reply awaiting kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 sendrecv kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 lat 0.000204 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 _do_lookup res is -2 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) AlternateNameRename_43224 = -2 2024-04-25T10:35:24.100 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 path_walk 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 _getattr mask As issued=1 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 3 client.4767 may_create 0x7f515c00bab0 = 0 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 8 client.4767 _create(0x1 AlternateNameRename_43224, 0777) 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) name AlternateNameRename_43224 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 15 open_dir 0x55fa3ad7a070 on 0x7f515c00bab0 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 15 client.4767 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) 'AlternateNameRename_43224' dn 0x1.head["AlternateNameRename_43224"] (new dn) 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.101 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 choose_target_mds inode dir hash is 2 on AlternateNameRename_43224 => 1788968174 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) is_hash=1 hash=1788968174 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 mds is 0 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 encode_cap_releases enter (req: 0x55fa3ad801c0, mds: 0) 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 encode_dentry_release enter(dn:0x7f515c00b310) 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bab0), req:0x55fa3ad801c0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 send_request set sent_stamp to 2024-04-25T10:35:23.931256+0000 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 10 client.4767 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRename_43224 (foo) 2024-04-25T10:35:23.931233+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRename_43224 (foo) 2024-04-25T10:35:23.931233+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aea2000 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f518d909480 20 client.4767 awaiting reply|forward|kick on 0x7ffc16ba78f0 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.930+0000 7f5185bd0640 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 849+0+0 (crc 0 0 0) 0x7f517c000bc0 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.102 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 insert_trace from 2024-04-25T10:35:23.931256+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 features 0xffffffffffffffff 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 update_snap_trace len 70 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref was 1 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref now is 2 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 update_inode_file_time 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) - ctime 2024-04-25T10:35:23.931233+0000 mtime 2024-04-25T10:35:23.931233+0000 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 12 client.4767 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 12 client.4767 add_update_inode adding 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=- objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref was 2 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref now is 3 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 15 client.4767 add_update_cap first one, opened snaprealm 0x7f515c00b9c0 2024-04-25T10:35:24.103 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 12 client.4767 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) caps pAsLsXs 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.916049+0000 ctime=2024-04-25T10:35:23.916049+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) pAsLsXs ctime 2024-04-25T10:35:23.931233+0000 mtime 2024-04-25T10:35:23.931233+0000 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 dir hash is 2 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 12 client.4767 add_update_inode client inode change_attr: 24 , mds inodestat change_attr: 25 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 12 client.4767 insert_dentry_inode 'AlternateNameRename_43224' vino 0x1000000000e.head in dir 0x1.head dn 0x7f515c00b310 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 15 client.4767 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 'AlternateNameRename_43224' to inode 0x7f515c00c090 dn 0x1.head["AlternateNameRename_43224"] (old dn) 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 link inode 0x7f515c00c090 parents now 0x1.head["AlternateNameRename_43224"] 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 15 client.4767 update_dentry_lease 0x1.head["AlternateNameRename_43224"] lease(mask 7 dur 30000 altn foo)) from 2024-04-25T10:35:23.931256+0000 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 10 client.4767 got dentry lease on AlternateNameRename_43224 dur 30000ms ttl 2024-04-25T10:35:53.931256+0000 2024-04-25T10:35:24.104 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 put_snap_realm 0x1 0x7f515c00b9c0 3 -> 2 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 handle_client_reply signalling caller 0x7ffc16ba78f0 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 handle_client_reply awaiting kickback on tid 3 0x7f5185bcddf0 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 20 client.4767 sendrecv kickback on tid 3 0x7f5185bcddf0 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 10 client.4767 delegated_inos: [] 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 10 client.4767 make_request created ino 0x1000000000e 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 20 client.4767 make_request target is 0x1000000000e.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 20 client.4767 lat 0.002108 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 10 break_deleg: breaking delegs on 0x1000000000e.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 10 delegations_broken: delegations empty on 0x1000000000e.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 10 client.4767 _create_fh 0x1000000000e mode 2 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 20 client.4767 trim_cache size 1 max 16384 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 8 client.4767 create(#0x1/AlternateNameRename_43224, 0100777 layout 0 0 0) = 0 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.105 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 3 client.4767 openat exit(AlternateNameRename_43224) 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 10 client.4767 get_quota_root realm 0x1 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 10 client.4767 get_quota_root 0x1000000000e.head -> 0x1.head 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 10 client.4767 cur file size is 0 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3ad75980 0x55fa3ad77da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- osd_op(unknown.0.0:1 3.37 3:eefe613f:::1000000000e.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ad782e0 con 0x55fa3ad75980 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- osd_op(unknown.0.0:2 3.37 3:eefe613f:::1000000000e.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ad78b50 con 0x55fa3ad75980 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.932+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.933+0000 7f5185bd0640 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.933+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3ad75980 0x55fa3ad77da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.933+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3ad75980 0x55fa3ad77da0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=92fe0040778f7677 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.106 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.933+0000 7f5185bd0640 10 client.4767 ms_handle_connect on v2:172.21.15.132:6816/2222857157 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.933+0000 7f5187bd4640 1 -- 172.21.15.103:0/2201767992 <== osd.7 v2:172.21.15.132:6816/2222857157 1 ==== osd_op_reply(1 1000000000e.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ad75980 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f5187bd4640 1 -- 172.21.15.103:0/2201767992 <== osd.7 v2:172.21.15.132:6816/2222857157 2 ==== osd_op_reply(2 1000000000e.00000000 [create] v23'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ad75980 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 wanted_max_size 0 -> 3 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 get_caps 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 20 client.4767 clear_suid_sgid 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 5 client.4767 get_cap_ref got first FILE_BUFFER ref on 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 5 client.4767 get_cap_ref got first FILE_CACHE ref on 0x1000000000e.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 mark_caps_dirty 0x1000000000e.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) - -> Fw 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 cap_delay_requeue on 0x1000000000e.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 get_quota_root realm 0x1 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 get_quota_root 0x1000000000e.head -> 0x1.head 2024-04-25T10:35:24.107 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 7 client.4767 wrote to 3, extending file size 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 mark_caps_dirty 0x1000000000e.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) Fw -> Fw 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 cap_delay_requeue on 0x1000000000e.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 3 client.4767 write(10, "...", 3, 0) = 3 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 3 client.4767 close enter(10) 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 8 client.4767 _release_fh 0x55fa3aeb99b0 mode 2 on 0x1000000000e.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 _flush 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- osd_op(unknown.0.0:3 3.37 3:eefe613f:::1000000000e.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ad782e0 con 0x55fa3ad75980 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 check_caps on 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 delaying cap release 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 cap_delay_requeue on 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 _release_fh 0x55fa3aeb99b0 on inode 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) no async_err state 2024-04-25T10:35:24.108 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 3 client.4767 close exit(10) 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 20 client.4767 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 path_walk 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 20 client.4767 path_walk cur=0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 path_walk 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 20 client.4767 may_delete 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0); ; name AlternateNameRename_43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 10 client.4767 _getattr mask As issued=1 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 3 client.4767 may_delete 0x7f515c00bab0 = 0 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.934+0000 7f518d909480 20 client.4767 may_delete 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0); ; name AlternateNameRename_432242; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 _getattr mask As issued=1 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 3 client.4767 may_delete 0x7f515c00bab0 = 0 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 8 client.4767 _rename(0x1 AlternateNameRename_43224 to 0x1 AlternateNameRename_432242 uid 0 gid 0) 2024-04-25T10:35:24.109 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 get_or_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) name AlternateNameRename_43224 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 get_or_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) name AlternateNameRename_432242 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 15 client.4767 link dir 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 'AlternateNameRename_432242' dn 0x1.head["AlternateNameRename_432242"] (new dn) 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 _lookup have 0x1.head["AlternateNameRename_43224"] from mds.0 ttl 2024-04-25T10:35:53.931256+0000 seq 2 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 _lookup 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) AlternateNameRename_43224 = 0x1000000000e.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 break_deleg: breaking delegs on 0x1000000000e.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 delegations_broken: delegations empty on 0x1000000000e.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 _lookup have 0x1.head["AlternateNameRename_432242"] from mds.-1 ttl 0.000000 seq 0 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 _do_lookup on #0x1/AlternateNameRename_432242 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 choose_target_mds inode dir hash is 2 on AlternateNameRename_432242 => 2917688928 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 choose_target_mds 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) is_hash=1 hash=2917688928 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 mds is 0 2024-04-25T10:35:24.110 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 send_request rebuilding request 4 for mds.0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 encode_cap_releases enter (req: 0x55fa3ad786a0, mds: 0) 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 send_request set sent_stamp to 2024-04-25T10:35:23.935544+0000 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 send_request client_request(unknown.0:4 lookup #0x1/AlternateNameRename_432242 2024-04-25T10:35:23.935531+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:4 lookup #0x1/AlternateNameRename_432242 2024-04-25T10:35:23.935531+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad78b00 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 awaiting reply|forward|kick on 0x7ffc16ba78e0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_reply(???:4 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f517c009b60 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 20 client.4767 handle_client_reply got a reply. Safe:1 tid 4 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 insert_trace from 2024-04-25T10:35:23.935544+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 insert_trace -- no trace 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 20 client.4767 handle_client_reply signalling caller 0x7ffc16ba78e0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 20 client.4767 handle_client_reply awaiting kickback on tid 4 0x7f5185bcddf0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 sendrecv kickback on tid 4 0x7f5185bcddf0 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 lat 0.000243 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 _do_lookup res is -2 2024-04-25T10:35:24.111 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 _lookup 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) AlternateNameRename_432242 = -2 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 choose_target_mds inode dir hash is 2 on AlternateNameRename_432242 => 2917688928 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 choose_target_mds 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) is_hash=1 hash=2917688928 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 choose_target_mds from dirfragtree hash 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 mds is 0 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 send_request rebuilding request 5 for mds.0 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 encode_cap_releases enter (req: 0x55fa3ad782e0, mds: 0) 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 encode_inode_release enter(in:0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090), req:0x55fa3ad782e0 mds:0, drop:Ls, unless:-, force:0) 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 encode_dentry_release enter(dn:0x55fa3ac792f0) 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0), req:0x55fa3ad782e0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 encode_dentry_release enter(dn:0x7f515c00b310) 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0), req:0x55fa3ad782e0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.112 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 send_request set sent_stamp to 2024-04-25T10:35:23.935857+0000 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 10 client.4767 send_request client_request(unknown.0:5 rename #0x1/AlternateNameRename_432242 (foo2) #0x1/AlternateNameRename_43224 2024-04-25T10:35:23.935811+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:5 rename #0x1/AlternateNameRename_432242 (foo2) #0x1/AlternateNameRename_43224 2024-04-25T10:35:23.935811+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad78f60 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f518d909480 20 client.4767 awaiting reply|forward|kick on 0x7ffc16ba7ae0 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_caps(revoke ino 0x1000000000e 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.931233+0000 ctime 2024-04-25T10:35:23.931233+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517c064040 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 5 client.4767 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 mds.0 seq now 1 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 5 client.4767 handle_cap_grant on in 0x1000000000e mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 update_inode_file_time 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:23.931233+0000 mtime 2024-04-25T10:35:23.931233+0000 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 revocation of AxXx 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 check_caps on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 completed revocation of AxXx 2024-04-25T10:35:24.113 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 mark_caps_flushing Fw 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 mark_caps_clean 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 send_cap 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 15 client.4767 auth cap, requesting max_size 3 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x1000000000e 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.935397+0000 ctime 2024-04-25T10:35:23.935397+0000 change_attr 1) -- 0x7f515c00c670 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.935+0000 7f5185bd0640 10 client.4767 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5187bd4640 1 -- 172.21.15.103:0/2201767992 <== osd.7 v2:172.21.15.132:6816/2222857157 3 ==== osd_op_reply(3 1000000000e.00000000 [write 0~3] v23'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ad75980 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f51777fe640 10 client.4767 _flushed 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f51777fe640 5 client.4767 put_cap_ref dropped last FILE_BUFFER ref on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f51777fe640 5 client.4767 put_cap_ref dropped last FILE_CACHE ref on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f51777fe640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 2 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f51777fe640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_reply(???:5 = 0 (0) Success unsafe) ==== 829+0+0 (crc 0 0 0) 0x7f517c018a30 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 handle_client_reply got a reply. Safe:0 tid 5 2024-04-25T10:35:24.114 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 insert_trace from 2024-04-25T10:35:23.935857+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 features 0xffffffffffffffff 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 update_snap_trace len 70 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref was 2 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref now is 3 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 12 client.4767 add_update_inode had 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) caps pAsLsXsFsxcrwb 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 update_inode_file_time 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935397+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) pAsXsFsxcrwb ctime 2024-04-25T10:35:23.935811+0000 mtime 2024-04-25T10:35:23.931233+0000 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 12 client.4767 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 1 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 add_update_cap issued pAsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_43224"] 0x7f515c00c090) 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 12 client.4767 add_update_inode had 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) caps pAsLsXs 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 update_inode_file_time 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.931233+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) pAsLsXs ctime 2024-04-25T10:35:23.935811+0000 mtime 2024-04-25T10:35:23.931233+0000 2024-04-25T10:35:24.115 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 dir hash is 2 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 12 client.4767 add_update_inode client inode change_attr: 25 , mds inodestat change_attr: 27 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 10 client.4767 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 12 client.4767 insert_dentry_inode 'AlternateNameRename_432242' vino 0x1000000000e.head in dir 0x1.head dn 0x55fa3ac792f0 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 15 client.4767 unlink dir 0x7f515c00bab0 'AlternateNameRename_43224' dn 0x7f515c00b310 inode 0x7f515c00c090 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 unlink inode 0x7f515c00c090 parents now 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 15 client.4767 unlink removing 'AlternateNameRename_43224' dn 0x7f515c00b310 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 15 client.4767 link dir 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 'AlternateNameRename_432242' to inode 0x7f515c00c090 dn 0x1.head["AlternateNameRename_432242"] (old dn) 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 link inode 0x7f515c00c090 parents now 0x1.head["AlternateNameRename_432242"] 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 15 client.4767 update_dentry_lease 0x1.head["AlternateNameRename_432242"] lease(mask 0 dur 0 altn foo2)) from 2024-04-25T10:35:23.935857+0000 2024-04-25T10:35:24.116 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 put_snap_realm 0x1 0x7f515c00b9c0 3 -> 2 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 handle_client_reply signalling caller 0x7ffc16ba7ae0 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f5185bd0640 20 client.4767 handle_client_reply awaiting kickback on tid 5 0x7f5185bcddf0 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 sendrecv kickback on tid 5 0x7f5185bcddf0 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 make_request target is 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 lat 0.001252 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 rename result is 0 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 trim_cache size 1 max 16384 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 8 client.4767 _rename(#0x1/AlternateNameRename_43224, #0x1/AlternateNameRename_432242) = 0 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 walk: AlternateNameRename_432242 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 path_walk cur=0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 path_walk AlternateNameRename_432242 2024-04-25T10:35:24.117 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 0 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) AlternateNameRename_432242 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 (path is AlternateNameRename_432242) 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 may_lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 _getattr mask As issued=1 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 3 client.4767 may_lookup 0x7f515c00bab0 = 0 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 _lookup have 0x1.head["AlternateNameRename_432242"] from mds.-1 ttl 0.000000 seq 0 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 _do_lookup on #0x1/AlternateNameRename_432242 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 choose_target_mds inode dir hash is 2 on AlternateNameRename_432242 => 2917688928 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 choose_target_mds 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) is_hash=1 hash=2917688928 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 mds is 0 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 send_request rebuilding request 6 for mds.0 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 encode_cap_releases enter (req: 0x55fa3ad78f60, mds: 0) 2024-04-25T10:35:24.118 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 send_request set sent_stamp to 2024-04-25T10:35:23.937160+0000 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 10 client.4767 send_request client_request(unknown.0:6 lookup #0x1/AlternateNameRename_432242 2024-04-25T10:35:23.937145+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:6 lookup #0x1/AlternateNameRename_432242 2024-04-25T10:35:23.937145+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae03b20 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.936+0000 7f518d909480 20 client.4767 awaiting reply|forward|kick on 0x7ffc16ba7940 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_reply(???:6 = 0 (0) Success) ==== 829+0+0 (crc 0 0 0) 0x7f517c018c20 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 handle_client_reply got a reply. Safe:1 tid 6 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 insert_trace from 2024-04-25T10:35:23.937160+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 features 0xffffffffffffffff 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 update_snap_trace len 70 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref was 2 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 get_snap_realm 0x1 0x7f515c00b9c0, nref now is 3 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 12 client.4767 add_update_inode had 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) caps pAsLsXsFsxcrwb 2024-04-25T10:35:24.119 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 update_inode_file_time 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) pAsLsXsFsxcrwb ctime 2024-04-25T10:35:23.935811+0000 mtime 2024-04-25T10:35:23.935397+0000 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 12 client.4767 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 1 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 add_update_cap issued pAsLsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 12 client.4767 add_update_inode had 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) caps pAsLsXs 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 update_inode_file_time 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.931233+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) pAsLsXs ctime 2024-04-25T10:35:23.935811+0000 mtime 2024-04-25T10:35:23.935811+0000 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 dir hash is 2 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 12 client.4767 add_update_inode client inode change_attr: 27 , mds inodestat change_attr: 27 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 12 client.4767 insert_dentry_inode 'AlternateNameRename_432242' vino 0x1000000000e.head in dir 0x1.head dn 0x55fa3ac792f0 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 12 client.4767 had dentry AlternateNameRename_432242 with correct vino 0x1000000000e.head 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 15 client.4767 update_dentry_lease 0x1.head["AlternateNameRename_432242"] lease(mask 7 dur 30000 altn foo2)) from 2024-04-25T10:35:23.937160+0000 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 got dentry lease on AlternateNameRename_432242 dur 30000ms ttl 2024-04-25T10:35:53.937160+0000 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_snap_realm 0x1 0x7f515c00b9c0 3 -> 2 2024-04-25T10:35:24.120 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 handle_client_reply signalling caller 0x7ffc16ba7940 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 handle_client_reply awaiting kickback on tid 6 0x7f5185bcddf0 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 sendrecv kickback on tid 6 0x7f5185bcddf0 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 make_request target is 0x1000000000e.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 lat 0.002471 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _do_lookup res is 0 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 _lookup have 0x1.head["AlternateNameRename_432242"] from mds.0 ttl 2024-04-25T10:35:53.937160+0000 seq 3 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _lookup 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) AlternateNameRename_432242 = 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 2 client.4767 unmount 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.121 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 unmounting: trim pass, size was 1+2 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 trim_cache size 1 max 16384 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 unmounting: trim pass, size still 1+2 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 2 client.4767 unmounting 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_reply(???:5 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f517c018e10 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3ad78b40 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 waiting for write request '5' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 handle_client_reply got a reply. Safe:1 tid 5 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 insert_trace from 2024-04-25T10:35:23.935857+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_432242"] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 unmounting: trim pass, size was 1+2 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 trim_cache size 1 max 16384 2024-04-25T10:35:24.122 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 15 client.4767 trim_dentry unlinking dn AlternateNameRename_432242 in dir 0x1 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 15 client.4767 unlink dir 0x7f515c00bab0 'AlternateNameRename_432242' dn 0x55fa3ac792f0 inode 0x7f515c00c090 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 unlink inode 0x7f515c00c090 parents now 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 15 client.4767 unlink removing 'AlternateNameRename_432242' dn 0x55fa3ac792f0 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 15 client.4767 close_dir dir 0x55fa3ad7a070 on 0x7f515c00bab0 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_caps(flush_ack ino 0x1000000000e 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f515c00c670 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _ll_drop_pins 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 _ll_put 0x7f515c00bab0 0x1 1 -> 0 2024-04-25T10:35:24.123 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 _release 0x1000000000e.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c090) 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _invalidate_inode_cache 0x1000000000e.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c090) 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _flush 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 nothing to flush 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 _release 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _flush 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 nothing to flush 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 1 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 flush_caps_sync 2024-04-25T10:35:24.124 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 waiting on mds.0 tid 2 (want 2) 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 mds.0 seq now 2 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 5 client.4767 handle_cap_flush_ack mds.0 cleaned Fw on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) with Fw 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 5 client.4767 flushing_caps Fw -> - 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) !flushing 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 put_inode on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) n = 1 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 unmounting: trim pass, size was 0+2 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 20 client.4767 trim_cache size 0 max 16384 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f5185bd0640 10 client.4767 unmounting: trim pass, size still 0+2 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 trim_cache size 0 max 16384 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) n = 24 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.125 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 15 client.4767 remove_cap last one, closing snaprealm 0x7f515c00b9c0 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_snap_realm 0x1 0x7f515c00b9c0 2 -> 1 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=- has_dir_layout 0x7f515c00bab0) 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _put_inode on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) n = 26 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 remove_cap mds.0 on 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 15 client.4767 remove_cap last one, closing snaprealm 0x7f515c00b9c0 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 20 client.4767 put_snap_realm 0x1 0x7f515c00b9c0 1 -> 0 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 10 client.4767 _put_inode deleting 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.931233+0000 mtime=2024-04-25T10:35:23.935397+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=1 caps=- objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c090) 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 2 client.4767 _close_mds_session mds.0 seq 2 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 2) -- 0x55fa3ae03cd0 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.939+0000 7f518d909480 2 client.4767 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 <== mds.0 v2:172.21.15.103:6834/2389441335 12 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ad78b40 con 0x55fa3ad7e3f0 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 10 client.4767 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 5 client.4767 _closed_mds_session mds.0 seq 2 2024-04-25T10:35:24.126 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 1 -- 172.21.15.103:0/2201767992 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7e3f0 msgr2=0x55fa3ad7add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad7e3f0 0x55fa3ad7add0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 10 client.4767 remove_session_caps mds.0 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 10 client.4767 kick_requests_closed for mds.0 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 10 client.4767 unmounting: trim pass, size was 0+0 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 20 client.4767 trim_cache size 0 max 16384 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5185bd0640 10 client.4767 unmounting: trim pass, size still 0+0 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 2 client.4767 unmounted. 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 client.4767 shutdown 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3ad75980 msgr2=0x55fa3ad77da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3ad75980 0x55fa3ad77da0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb2d70 msgr2=0x55fa3ad38280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 --2- 172.21.15.103:0/2201767992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb2d70 0x55fa3ad38280 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5180021460 tx=0x55fa3adf7990 comp rx=0 tx=0).stop 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f5187bd4640 1 -- 172.21.15.103:0/2201767992 reap_dead start 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 shutdown_connections 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 >> 172.21.15.103:0/2201767992 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:24.127 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 shutdown_connections 2024-04-25T10:35:24.128 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 1 -- 172.21.15.103:0/2201767992 wait complete. 2024-04-25T10:35:24.128 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.943+0000 7f518d909480 20 client.4767 trim_cache size 0 max 16384 2024-04-25T10:35:24.128 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameRename (19 ms) 2024-04-25T10:35:24.128 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameRenameExistMatch 2024-04-25T10:35:24.151 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.944+0000 7f518d909480 1 -- start start 2024-04-25T10:35:24.151 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:24.151 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a360 0x55fa3ad38280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.151 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3adf4320 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.151 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.151 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c009c50 con 0x55fa3adf4320 2024-04-25T10:35:24.151 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae9f450 con 0x55fa3aeb1180 2024-04-25T10:35:24.151 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3adff260 con 0x55fa3ad7a360 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3adf4320 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f5186bd2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3adf4320 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50638/0 (socket says 172.21.15.103:50638) 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f5186bd2640 1 -- 172.21.15.103:0/3183989606 learned_addr learned my addr 172.21.15.103:0/3183989606 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f51873d3640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a360 0x55fa3ad38280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.945+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5186bd2640 1 -- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a360 msgr2=0x55fa3ad38280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a360 0x55fa3ad38280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5186bd2640 1 -- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 msgr2=0x55fa3ad7add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3ad7add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5186bd2640 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3aeb0710 con 0x55fa3adf4320 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3aeb1180 0x55fa3ad7add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f51873d3640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad7a360 0x55fa3ad38280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5186bd2640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3adf4320 0x55fa3aeb8fa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f517c00b010 tx=0x7f517c041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4ad120c0a7ca05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:24.152 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c06b040 con 0x55fa3adf4320 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517c016440 con 0x55fa3adf4320 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 10 client.4770 Subscribing to map 'mdsmap' 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3aeb99b0 con 0x55fa3adf4320 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f51767fc640 20 client.4770 tick 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f51767fc640 20 client.4770 collect_and_send_metrics 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f51767fc640 20 client.4770 collect_and_send_global_metrics 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f51767fc640 5 client.4770 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f51767fc640 20 client.4770 trim_cache size 0 max 16384 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f51767fc640 20 client.4770 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c07f070 con 0x55fa3adf4320 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f517c061040 con 0x55fa3adf4320 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f5184bce640 1 client.4770 handle_mds_map epoch 6 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 20 client.4770 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 10 client.4770 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.153 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 20 client.4770 mds is 0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 10 client.4770 _open_mds_session mds.0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 0x55fa3adf7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3aea20c0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f518d909480 10 client.4770 waiting for session to mds.0 to open 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.946+0000 7f51873d3640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 0x55fa3adf7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.947+0000 7f5184bce640 10 client.4770 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.947+0000 7f51873d3640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 0x55fa3adf7690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c69b8aaa80eeb0ff server_cookie=5091d30769252fe9 in_seq=0 out_seq=0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3aea20c0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 renew_caps mds.0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f515c00b610 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 connect_mds_targets for mds.0 2024-04-25T10:35:24.154 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 mds is 0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 encode_cap_releases enter (req: 0x55fa3ad7e540, mds: 0) 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 send_request set sent_stamp to 2024-04-25T10:35:23.949762+0000 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.947168+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.947168+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adffd20 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f515c00b610 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f51800bd080 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.949762+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 features 0xffffffffffffffff 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 update_snap_trace len 70 2024-04-25T10:35:24.155 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref now is 1 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 15 client.4770 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 15 client.4770 snapc 1=[] 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 2 -> 1 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 hrm is_target=1 is_dentry=0 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f515c00bba0) - ctime 2024-04-25T10:35:23.935811+0000 mtime 2024-04-25T10:35:23.935811+0000 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 dir hash is 2 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 27 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 12 client.4770 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=- has_dir_layout 0x7f515c00bba0) caps pAsLsXsFs 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref was 1 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref now is 2 2024-04-25T10:35:24.156 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 15 client.4770 add_update_cap first one, opened snaprealm 0x7f515c00bab0 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 2 -> 1 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 lat 0.000430 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 _ll_get 0x7f515c00bba0 0x1 -> 1 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 3 client.4770 openat enter(AlternateNameRenameExistMatch_43224) 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 path_walk AlternateNameRenameExistMatch_43224 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) AlternateNameRenameExistMatch_43224 2024-04-25T10:35:24.157 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 (path is AlternateNameRenameExistMatch_43224) 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 _getattr mask As issued=1 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 3 client.4770 may_lookup 0x7f515c00bba0 = 0 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 _do_lookup on #0x1/AlternateNameRenameExistMatch_43224 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_43224 => 2146672126 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) is_hash=1 hash=2146672126 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 mds is 0 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 encode_cap_releases enter (req: 0x55fa3ad792f0, mds: 0) 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 send_request set sent_stamp to 2024-04-25T10:35:23.950268+0000 2024-04-25T10:35:24.158 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameRenameExistMatch_43224 2024-04-25T10:35:23.950252+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/AlternateNameRenameExistMatch_43224 2024-04-25T10:35:23.950252+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aebff70 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 awaiting reply|forward|kick on 0x7ffc16ba7610 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f518005ea00 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.950268+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 10 client.4770 insert_trace -- no trace 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 handle_client_reply signalling caller 0x7ffc16ba7610 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f5184bce640 20 client.4770 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 lat 0.000200 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 _do_lookup res is -2 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) AlternateNameRenameExistMatch_43224 = -2 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.159 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 10 client.4770 path_walk 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.949+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 10 client.4770 _getattr mask As issued=1 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 3 client.4770 may_create 0x7f515c00bba0 = 0 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 8 client.4770 _create(0x1 AlternateNameRenameExistMatch_43224, 0777) 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) name AlternateNameRenameExistMatch_43224 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 15 open_dir 0x55fa3adffbe0 on 0x7f515c00bba0 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 15 client.4770 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) 'AlternateNameRenameExistMatch_43224' dn 0x1.head["AlternateNameRenameExistMatch_43224"] (new dn) 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_43224 => 2146672126 2024-04-25T10:35:24.160 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) is_hash=1 hash=2146672126 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 10 client.4770 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 mds is 0 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 10 client.4770 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 encode_cap_releases enter (req: 0x55fa3aebff70, mds: 0) 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 encode_dentry_release enter(dn:0x7f515c00b8d0) 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f515c00bba0), req:0x55fa3aebff70 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 send_request set sent_stamp to 2024-04-25T10:35:23.950538+0000 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 10 client.4770 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMatch_43224 (foo) 2024-04-25T10:35:23.950520+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMatch_43224 (foo) 2024-04-25T10:35:23.950520+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aec0360 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f518d909480 20 client.4770 awaiting reply|forward|kick on 0x7ffc16ba78d0 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.950+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 859+0+0 (crc 0 0 0) 0x7f51800620d0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.950538+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.161 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 features 0xffffffffffffffff 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 update_snap_trace len 70 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref was 1 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref now is 2 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) - ctime 2024-04-25T10:35:23.950520+0000 mtime 2024-04-25T10:35:23.950520+0000 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 12 client.4770 add_update_inode adding 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=- objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref was 2 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref now is 3 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 15 client.4770 add_update_cap first one, opened snaprealm 0x7f515c00bab0 2024-04-25T10:35:24.162 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 12 client.4770 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) caps pAsLsXs 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.935811+0000 ctime=2024-04-25T10:35:23.935811+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) pAsLsXs ctime 2024-04-25T10:35:23.950520+0000 mtime 2024-04-25T10:35:23.950520+0000 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 dir hash is 2 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 27 , mds inodestat change_attr: 28 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 12 client.4770 insert_dentry_inode 'AlternateNameRenameExistMatch_43224' vino 0x1000000000f.head in dir 0x1.head dn 0x7f515c00b8d0 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 15 client.4770 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 'AlternateNameRenameExistMatch_43224' to inode 0x7f515c00c180 dn 0x1.head["AlternateNameRenameExistMatch_43224"] (old dn) 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 link inode 0x7f515c00c180 parents now 0x1.head["AlternateNameRenameExistMatch_43224"] 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.163 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 15 client.4770 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_43224"] lease(mask 7 dur 30000 altn foo)) from 2024-04-25T10:35:23.950538+0000 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 got dentry lease on AlternateNameRenameExistMatch_43224 dur 30000ms ttl 2024-04-25T10:35:53.950538+0000 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 3 -> 2 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 handle_client_reply signalling caller 0x7ffc16ba78d0 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 20 client.4770 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 10 client.4770 delegated_inos: [] 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 10 client.4770 make_request created ino 0x1000000000f 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 20 client.4770 make_request target is 0x1000000000f.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 20 client.4770 lat 0.002305 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 10 break_deleg: breaking delegs on 0x1000000000f.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 10 delegations_broken: delegations empty on 0x1000000000f.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.164 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 10 client.4770 _create_fh 0x1000000000f mode 2 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 20 client.4770 trim_cache size 1 max 16384 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 8 client.4770 create(#0x1/AlternateNameRenameExistMatch_43224, 0100777 layout 0 0 0) = 0 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 3 client.4770 openat exit(AlternateNameRenameExistMatch_43224) 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 10 client.4770 get_quota_root realm 0x1 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 10 client.4770 get_quota_root 0x1000000000f.head -> 0x1.head 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 10 client.4770 cur file size is 0 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3ae0cb60 0x55fa3ae9e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- osd_op(unknown.0.0:1 3.12 3:49e35fbc:::1000000000f.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ad77480 con 0x55fa3ae0cb60 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- osd_op(unknown.0.0:2 3.12 3:49e35fbc:::1000000000f.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ad77cf0 con 0x55fa3ae0cb60 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.165 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3ae0cb60 0x55fa3ae9e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5184bce640 10 client.4770 ms_handle_connect on v2:172.21.15.103:6808/1654732884 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.952+0000 7f5187bd4640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3ae0cb60 0x55fa3ae9e090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=a280c6a05edffe20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.953+0000 7f5187bd4640 1 -- 172.21.15.103:0/3183989606 <== osd.0 v2:172.21.15.103:6808/1654732884 1 ==== osd_op_reply(1 1000000000f.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ae0cb60 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f5187bd4640 1 -- 172.21.15.103:0/3183989606 <== osd.0 v2:172.21.15.103:6808/1654732884 2 ==== osd_op_reply(2 1000000000f.00000000 [create] v23'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ae0cb60 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 wanted_max_size 0 -> 3 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 get_caps 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 clear_suid_sgid 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 5 client.4770 get_cap_ref got first FILE_BUFFER ref on 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 5 client.4770 get_cap_ref got first FILE_CACHE ref on 0x1000000000f.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 mark_caps_dirty 0x1000000000f.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) - -> Fw 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 cap_delay_requeue on 0x1000000000f.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.166 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 get_quota_root realm 0x1 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 get_quota_root 0x1000000000f.head -> 0x1.head 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 7 client.4770 wrote to 3, extending file size 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 mark_caps_dirty 0x1000000000f.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) Fw -> Fw 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 cap_delay_requeue on 0x1000000000f.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 3 client.4770 write(10, "...", 3, 0) = 3 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 3 client.4770 close enter(10) 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 8 client.4770 _release_fh 0x55fa3ad7efb0 mode 2 on 0x1000000000f.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 _flush 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- osd_op(unknown.0.0:3 3.12 3:49e35fbc:::1000000000f.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ad77480 con 0x55fa3ae0cb60 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 check_caps on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 delaying cap release 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 cap_delay_requeue on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.167 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 _release_fh 0x55fa3ad7efb0 on inode 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) no async_err state 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 3 client.4770 close exit(10) 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 3 client.4770 openat enter(AlternateNameRenameExistMatch_432242) 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 path_walk cur=0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 path_walk AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 0 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 (path is AlternateNameRenameExistMatch_432242) 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 may_lookup 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 _getattr mask As issued=1 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 3 client.4770 may_lookup 0x7f515c00bba0 = 0 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 _do_lookup on #0x1/AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_432242 => 1004283001 2024-04-25T10:35:24.168 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 choose_target_mds 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) is_hash=1 hash=1004283001 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 mds is 0 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 send_request rebuilding request 4 for mds.0 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 encode_cap_releases enter (req: 0x55fa3ad77480, mds: 0) 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 send_request set sent_stamp to 2024-04-25T10:35:23.955210+0000 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 10 client.4770 send_request client_request(unknown.0:4 lookup #0x1/AlternateNameRenameExistMatch_432242 2024-04-25T10:35:23.955185+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:4 lookup #0x1/AlternateNameRenameExistMatch_432242 2024-04-25T10:35:23.955185+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad77840 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f518d909480 20 client.4770 awaiting reply|forward|kick on 0x7ffc16ba7610 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_reply(???:4 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f5180062c60 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:1 tid 4 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.955210+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f5184bce640 10 client.4770 insert_trace -- no trace 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f5184bce640 20 client.4770 handle_client_reply signalling caller 0x7ffc16ba7610 2024-04-25T10:35:24.169 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.954+0000 7f5184bce640 20 client.4770 handle_client_reply awaiting kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 sendrecv kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 lat 0.000293 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 _do_lookup res is -2 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 _lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) AlternateNameRenameExistMatch_432242 = -2 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 path_walk cur=0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 path_walk 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 may_create 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.170 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 _getattr mask As issued=1 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 3 client.4770 may_create 0x7f515c00bba0 = 0 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 8 client.4770 _create(0x1 AlternateNameRenameExistMatch_432242, 0777) 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 get_or_create 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) name AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 15 client.4770 link dir 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 'AlternateNameRenameExistMatch_432242' dn 0x1.head["AlternateNameRenameExistMatch_432242"] (new dn) 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_432242 => 1004283001 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 choose_target_mds 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) is_hash=1 hash=1004283001 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 choose_target_mds from dirfragtree hash 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 mds is 0 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 send_request rebuilding request 5 for mds.0 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 encode_cap_releases enter (req: 0x55fa3ad77840, mds: 0) 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 encode_dentry_release enter(dn:0x55fa3acaccd0) 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0), req:0x55fa3ad77840 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 send_request set sent_stamp to 2024-04-25T10:35:23.955608+0000 2024-04-25T10:35:24.171 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 send_request client_request(unknown.0:5 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMatch_432242 (foo2) 2024-04-25T10:35:23.955580+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:5 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMatch_432242 (foo2) 2024-04-25T10:35:23.955580+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad77d50 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 awaiting reply|forward|kick on 0x7ffc16ba78d0 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:5 = 0 (0) Success unsafe) ==== 877+0+0 (crc 0 0 0) 0x7f518005e3a0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:0 tid 5 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.955608+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 features 0xffffffffffffffff 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 update_snap_trace len 70 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref was 2 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref now is 3 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) - ctime 2024-04-25T10:35:23.955580+0000 mtime 2024-04-25T10:35:23.955580+0000 2024-04-25T10:35:24.172 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 12 client.4770 add_update_inode adding 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=- objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref was 3 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref now is 4 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 15 client.4770 add_update_cap first one, opened snaprealm 0x7f515c00bab0 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 12 client.4770 add_update_inode had 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) caps pAsLsXs 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.950520+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) pAsLsXs ctime 2024-04-25T10:35:23.955580+0000 mtime 2024-04-25T10:35:23.950520+0000 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 dir hash is 2 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 28 , mds inodestat change_attr: 29 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 12 client.4770 insert_dentry_inode 'AlternateNameRenameExistMatch_432242' vino 0x10000000010.head in dir 0x1.head dn 0x55fa3acaccd0 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 15 client.4770 link dir 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 'AlternateNameRenameExistMatch_432242' to inode 0x7f515c00c760 dn 0x1.head["AlternateNameRenameExistMatch_432242"] (old dn) 2024-04-25T10:35:24.173 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 link inode 0x7f515c00c760 parents now 0x1.head["AlternateNameRenameExistMatch_432242"] 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 15 client.4770 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_432242"] lease(mask 7 dur 30000 altn foo2)) from 2024-04-25T10:35:23.955608+0000 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 10 client.4770 got dentry lease on AlternateNameRenameExistMatch_432242 dur 30000ms ttl 2024-04-25T10:35:53.955608+0000 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 4 -> 3 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 handle_client_reply signalling caller 0x7ffc16ba78d0 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5184bce640 20 client.4770 handle_client_reply awaiting kickback on tid 5 0x7f5184bcbdf0 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 sendrecv kickback on tid 5 0x7f5184bcbdf0 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 delegated_inos: [0x10000000011~0x1f4] 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 make_request created ino 0x10000000010 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 make_request target is 0x10000000010.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 lat 0.000763 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000010.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.174 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f5187bd4640 1 -- 172.21.15.103:0/3183989606 <== osd.0 v2:172.21.15.103:6808/1654732884 3 ==== osd_op_reply(3 1000000000f.00000000 [write 0~3] v23'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5178067020 con 0x55fa3ae0cb60 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000010.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 _create_fh 0x10000000010 mode 2 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 trim_cache size 2 max 16384 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 8 client.4770 create(#0x1/AlternateNameRenameExistMatch_432242, 0100777 layout 0 0 0) = 0 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 3 client.4770 openat exit(AlternateNameRenameExistMatch_432242) 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 get_quota_root realm 0x1 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 get_quota_root 0x10000000010.head -> 0x1.head 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 cur file size is 0 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 wanted_max_size 0 -> 3 2024-04-25T10:35:24.175 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 get_caps 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 20 client.4770 clear_suid_sgid 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 10 client.4770 snaprealm snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 5 client.4770 get_cap_ref got first FILE_BUFFER ref on 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.955+0000 7f518d909480 5 client.4770 get_cap_ref got first FILE_CACHE ref on 0x10000000010.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 mark_caps_dirty 0x10000000010.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) - -> Fw 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 cap_delay_requeue on 0x10000000010.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.955580+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 get_quota_root realm 0x1 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 get_quota_root 0x10000000010.head -> 0x1.head 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 7 client.4770 wrote to 3, extending file size 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 mark_caps_dirty 0x10000000010.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) Fw -> Fw 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 cap_delay_requeue on 0x10000000010.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 3 client.4770 write(10, "...", 3, 0) = 3 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 3 client.4770 close enter(10) 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 8 client.4770 _release_fh 0x55fa3ad7efb0 mode 2 on 0x10000000010.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.176 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 _flush 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3aec5ad0 0x55fa3aec7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- osd_op(unknown.0.0:4 3.3b 3:dde6a3df:::10000000010.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3aec8430 con 0x55fa3aec5ad0 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 check_caps on 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 delaying cap release 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 cap_delay_requeue on 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 _release_fh 0x55fa3ad7efb0 on inode 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) no async_err state 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 3 client.4770 close exit(10) 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f51777fe640 10 client.4770 _flushed 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f51777fe640 5 client.4770 put_cap_ref dropped last FILE_BUFFER ref on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.177 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f51777fe640 5 client.4770 put_cap_ref dropped last FILE_CACHE ref on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f51777fe640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 2 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f51777fe640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 path_walk cur=0x1.head(faked_ino=0 nref=26 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 path_walk 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 path_walk cur=0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 path_walk 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 may_delete 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0); ; name AlternateNameRenameExistMatch_43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 _getattr mask As issued=1 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 3 client.4770 may_delete 0x7f515c00bba0 = 0 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 may_delete 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0); ; name AlternateNameRenameExistMatch_432242; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 _getattr mask As issued=1 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 3 client.4770 may_delete 0x7f515c00bba0 = 0 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 8 client.4770 _rename(0x1 AlternateNameRenameExistMatch_43224 to 0x1 AlternateNameRenameExistMatch_432242 uid 0 gid 0) 2024-04-25T10:35:24.178 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f51873d3640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3aec5ad0 0x55fa3aec7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 get_or_create 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) name AlternateNameRenameExistMatch_43224 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 get_or_create 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) name AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 _lookup have 0x1.head["AlternateNameRenameExistMatch_43224"] from mds.0 ttl 2024-04-25T10:35:53.950538+0000 seq 2 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 _lookup 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) AlternateNameRenameExistMatch_43224 = 0x1000000000f.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 break_deleg: breaking delegs on 0x1000000000f.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 delegations_broken: delegations empty on 0x1000000000f.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 _lookup have 0x1.head["AlternateNameRenameExistMatch_432242"] from mds.0 ttl 2024-04-25T10:35:53.955608+0000 seq 3 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 _lookup 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) AlternateNameRenameExistMatch_432242 = 0x10000000010.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.179 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_432242 => 1004283001 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 choose_target_mds 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) is_hash=1 hash=1004283001 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 choose_target_mds from dirfragtree hash 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 mds is 0 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 send_request rebuilding request 6 for mds.0 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 encode_cap_releases enter (req: 0x55fa3aec87d0, mds: 0) 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 encode_inode_release enter(in:0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180), req:0x55fa3aec87d0 mds:0, drop:Ls, unless:-, force:0) 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 encode_inode_release enter(in:0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760), req:0x55fa3aec87d0 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 encode_dentry_release enter(dn:0x55fa3acaccd0) 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0), req:0x55fa3aec87d0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 encode_dentry_release enter(dn:0x7f515c00b8d0) 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0), req:0x55fa3aec87d0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 send_request set sent_stamp to 2024-04-25T10:35:23.956907+0000 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 10 client.4770 send_request client_request(unknown.0:6 rename #0x1/AlternateNameRenameExistMatch_432242 (foo2) #0x1/AlternateNameRenameExistMatch_43224 2024-04-25T10:35:23.956853+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.180 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:6 rename #0x1/AlternateNameRenameExistMatch_432242 (foo2) #0x1/AlternateNameRenameExistMatch_43224 2024-04-25T10:35:23.956853+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aec8b30 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f518d909480 20 client.4770 awaiting reply|forward|kick on 0x7ffc16ba7ac0 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(revoke ino 0x1000000000f 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.950520+0000 ctime 2024-04-25T10:35:23.950520+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f5180062610 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 5 client.4770 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 mds.0 seq now 1 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 5 client.4770 handle_cap_grant on in 0x1000000000f mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:23.950520+0000 mtime 2024-04-25T10:35:23.950520+0000 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 revocation of AxXx 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f51873d3640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3aec5ad0 0x55fa3aec7ef0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=1e8727937c524c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 check_caps on 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) wanted - used Fc issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 completed revocation of AxXx 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 mark_caps_flushing Fw 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 mark_caps_clean 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.181 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 send_cap 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) mds.0 seq 2 used Fc want - flush Fw retain pAsLsXsFsc held pAsxXsxFsxcrwb revoking AxXx dropping Fxrwb 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 15 client.4770 auth cap, reset requested_max_size due to not wanting any file write cap 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x1000000000f 1 seq 2 tid 2 caps=pAsXsFsc dirty=Fw wanted=- follows 1 size 3/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.955084+0000 ctime 2024-04-25T10:35:23.955084+0000 change_attr 1) -- 0x7f515c00cd40 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 ms_handle_connect on v2:172.21.15.132:6816/2222857157 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_caps(revoke ino 0x10000000010 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.955580+0000 ctime 2024-04-25T10:35:23.955580+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f518000a1b0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 mds.0 seq now 2 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 5 client.4770 handle_cap_grant on in 0x10000000010 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:23.955580+0000 mtime 2024-04-25T10:35:23.955580+0000 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 revocation of AxXx 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 check_caps on 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 completed revocation of AxXx 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 mark_caps_flushing Fw 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.182 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 mark_caps_clean 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 send_cap 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 15 client.4770 auth cap, requesting max_size 3 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000010 1 seq 2 tid 3 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.956523+0000 ctime 2024-04-25T10:35:23.956523+0000 change_attr 1) -- 0x7f5180062610 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.956+0000 7f5184bce640 10 client.4770 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f51873d3640 1 -- 172.21.15.103:0/3183989606 <== osd.7 v2:172.21.15.132:6816/2222857157 1 ==== osd_op_reply(4 10000000010.00000000 [write 0~3] v23'1 uv1 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f518007d070 con 0x55fa3aec5ad0 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f51777fe640 10 client.4770 _flushed 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f51777fe640 5 client.4770 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f51777fe640 5 client.4770 put_cap_ref dropped last FILE_CACHE ref on 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f51777fe640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) n = 2 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f51777fe640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_reply(???:6 = 0 (0) Success unsafe) ==== 839+0+0 (crc 0 0 0) 0x7f5180054440 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:0 tid 6 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.956907+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.183 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 features 0xffffffffffffffff 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 update_snap_trace len 70 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref was 3 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref now is 4 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 12 client.4770 add_update_inode had 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) caps pAsLsXsFsxcrwb 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.955084+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) pAsXsFscw ctime 2024-04-25T10:35:23.956853+0000 mtime 2024-04-25T10:35:23.950520+0000 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 1 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 add_update_cap issued pAsXsFsc -> pAsLsXsFsxcrwb from mds.0 on 0x1000000000f.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_43224"] 0x7f515c00c180) 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 12 client.4770 add_update_inode had 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) caps pAsLsXs 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.955580+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) pAsLsXs ctime 2024-04-25T10:35:23.956853+0000 mtime 2024-04-25T10:35:23.950520+0000 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 dir hash is 2 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 29 , mds inodestat change_attr: 32 2024-04-25T10:35:24.184 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 10 client.4770 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 12 client.4770 insert_dentry_inode 'AlternateNameRenameExistMatch_432242' vino 0x1000000000f.head in dir 0x1.head dn 0x55fa3acaccd0 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 12 client.4770 had dentry AlternateNameRenameExistMatch_432242 with WRONG vino 0x10000000010.head 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 15 client.4770 unlink dir 0x7f515c00bba0 'AlternateNameRenameExistMatch_432242' dn 0x55fa3acaccd0 inode 0x7f515c00c760 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 unlink inode 0x7f515c00c760 parents now 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 15 client.4770 unlink dir 0x7f515c00bba0 'AlternateNameRenameExistMatch_43224' dn 0x7f515c00b8d0 inode 0x7f515c00c180 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 unlink inode 0x7f515c00c180 parents now 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 15 client.4770 unlink removing 'AlternateNameRenameExistMatch_43224' dn 0x7f515c00b8d0 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 15 client.4770 link dir 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 'AlternateNameRenameExistMatch_432242' to inode 0x7f515c00c180 dn 0x1.head["AlternateNameRenameExistMatch_432242"] (old dn) 2024-04-25T10:35:24.185 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 link inode 0x7f515c00c180 parents now 0x1.head["AlternateNameRenameExistMatch_432242"] 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 15 client.4770 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_432242"] lease(mask 0 dur 0 altn foo2)) from 2024-04-25T10:35:23.956907+0000 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 4 -> 3 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 handle_client_reply signalling caller 0x7ffc16ba7ac0 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f5184bce640 20 client.4770 handle_client_reply awaiting kickback on tid 6 0x7f5184bcbdf0 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 sendrecv kickback on tid 6 0x7f5184bcbdf0 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 make_request target is 0x1000000000f.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 lat 0.001941 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 rename result is 0 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 trim_cache size 1 max 16384 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 8 client.4770 _rename(#0x1/AlternateNameRenameExistMatch_43224, #0x1/AlternateNameRenameExistMatch_432242) = 0 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.186 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 walk: AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 path_walk cur=0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 path_walk AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 0 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 (path is AlternateNameRenameExistMatch_432242) 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 may_lookup 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 _getattr mask As issued=1 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 3 client.4770 may_lookup 0x7f515c00bba0 = 0 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 _lookup have 0x1.head["AlternateNameRenameExistMatch_432242"] from mds.-1 ttl 2024-04-25T10:35:53.955608+0000 seq 3 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 _do_lookup on #0x1/AlternateNameRenameExistMatch_432242 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_432242 => 1004283001 2024-04-25T10:35:24.187 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 choose_target_mds 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) is_hash=1 hash=1004283001 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 mds is 0 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 send_request rebuilding request 7 for mds.0 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 encode_cap_releases enter (req: 0x55fa3aec8b30, mds: 0) 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 send_request set sent_stamp to 2024-04-25T10:35:23.958943+0000 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 10 client.4770 send_request client_request(unknown.0:7 lookup #0x1/AlternateNameRenameExistMatch_432242 2024-04-25T10:35:23.958913+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:7 lookup #0x1/AlternateNameRenameExistMatch_432242 2024-04-25T10:35:23.958913+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad78230 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.958+0000 7f518d909480 20 client.4770 awaiting reply|forward|kick on 0x7ffc16ba7920 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.960+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_caps(grant ino 0x10000000010 1 seq 3 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 3/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.956523+0000 ctime 2024-04-25T10:35:23.956853+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f5180062610 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.960+0000 7f5184bce640 10 client.4770 mds.0 seq now 3 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.960+0000 7f5184bce640 5 client.4770 handle_cap_grant on in 0x10000000010 mds.0 seq 3 caps now pAsXsFsxcrwb was pAsXsFsxcrwb 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956523+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) pAsXsFsxcrwb ctime 2024-04-25T10:35:23.956853+0000 mtime 2024-04-25T10:35:23.956523+0000 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 10 client.4770 caps unchanged at pAsXsFsxcrwb 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 10 client.4770 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.188 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 12 ==== client_reply(???:5 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f51800547a0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:1 tid 5 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.955608+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 10 client.4770 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.961+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 13 ==== client_reply(???:7 = 0 (0) Success) ==== 839+0+0 (crc 0 0 0) 0x7f5180054d40 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:1 tid 7 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.958943+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 features 0xffffffffffffffff 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 update_snap_trace len 70 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref was 3 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 get_snap_realm 0x1 0x7f515c00bab0, nref now is 4 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.189 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 12 client.4770 add_update_inode had 0x1000000000f.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) caps pAsLsXsFsxcrwb 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) pAsLsXsFsxcrwb ctime 2024-04-25T10:35:23.956853+0000 mtime 2024-04-25T10:35:23.955084+0000 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 1 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 add_update_cap issued pAsLsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x1000000000f.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 12 client.4770 add_update_inode had 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) caps pAsLsXs 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.950520+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) pAsLsXs ctime 2024-04-25T10:35:23.956853+0000 mtime 2024-04-25T10:35:23.956853+0000 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 dir hash is 2 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 12 client.4770 add_update_inode client inode change_attr: 32 , mds inodestat change_attr: 32 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 12 client.4770 insert_dentry_inode 'AlternateNameRenameExistMatch_432242' vino 0x1000000000f.head in dir 0x1.head dn 0x55fa3acaccd0 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 12 client.4770 had dentry AlternateNameRenameExistMatch_432242 with correct vino 0x1000000000f.head 2024-04-25T10:35:24.190 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 15 client.4770 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_432242"] lease(mask 7 dur 30000 altn foo2)) from 2024-04-25T10:35:23.958943+0000 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 got dentry lease on AlternateNameRenameExistMatch_432242 dur 30000ms ttl 2024-04-25T10:35:53.958943+0000 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 4 -> 3 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 handle_client_reply signalling caller 0x7ffc16ba7920 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 handle_client_reply awaiting kickback on tid 7 0x7f5184bcbdf0 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 sendrecv kickback on tid 7 0x7f5184bcbdf0 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 make_request target is 0x1000000000f.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 lat 0.004140 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _do_lookup res is 0 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 _lookup have 0x1.head["AlternateNameRenameExistMatch_432242"] from mds.0 ttl 2024-04-25T10:35:53.958943+0000 seq 4 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _lookup 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) AlternateNameRenameExistMatch_432242 = 0x1000000000f.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.191 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 2 client.4770 unmount 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size was 1+3 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 trim_cache size 1 max 16384 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size still 1+3 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 2 client.4770 unmounting 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3ad78230 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 waiting for write request '6' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 14 ==== client_caps(grant ino 0x10000000010 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=LsFxcb follows 0 size 3/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:23.956523+0000 ctime 2024-04-25T10:35:23.956853+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f515c00cd40 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 mds.0 seq now 4 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 5 client.4770 handle_cap_grant on in 0x10000000010 mds.0 seq 4 caps now pAsLsXsFsxcrwb was pAsXsFsxcrwb 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 update_inode_file_time 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) pAsXsFsxcrwb ctime 2024-04-25T10:35:23.956853+0000 mtime 2024-04-25T10:35:23.956523+0000 2024-04-25T10:35:24.192 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 grant, new caps are Ls 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 5 client.4770 _try_to_trim_inode in 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size was 1+3 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 trim_cache size 1 max 16384 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size still 1+3 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 15 ==== client_reply(???:6 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f5180077440 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 handle_client_reply got a reply. Safe:1 tid 6 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 insert_trace from 2024-04-25T10:35:23.956907+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_432242"] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.193 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 5 client.4770 _try_to_trim_inode in 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size was 1+3 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 trim_cache size 1 max 16384 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 15 client.4770 trim_dentry unlinking dn AlternateNameRenameExistMatch_432242 in dir 0x1 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 15 client.4770 unlink dir 0x7f515c00bba0 'AlternateNameRenameExistMatch_432242' dn 0x55fa3acaccd0 inode 0x7f515c00c180 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 unlink inode 0x7f515c00c180 parents now 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 15 client.4770 unlink removing 'AlternateNameRenameExistMatch_432242' dn 0x55fa3acaccd0 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 15 client.4770 close_dir dir 0x55fa3adffbe0 on 0x7f515c00bba0 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f5184bce640 10 client.4770 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.194 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _ll_drop_pins 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 _ll_put 0x7f515c00bba0 0x1 1 -> 0 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=31 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=31 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 _release 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _invalidate_inode_cache 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c760) 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _flush 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 nothing to flush 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 _release 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c180) 2024-04-25T10:35:24.195 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _invalidate_inode_cache 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f515c00c180) 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _flush 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 nothing to flush 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 _release 0x1.head(faked_ino=0 nref=32 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=32 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 _flush 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 nothing to flush 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 20 client.4770 put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 1 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 flush_caps_sync 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 wait_sync_caps want 3 (last is 3, 2 total flushing) 2024-04-25T10:35:24.196 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.962+0000 7f518d909480 10 client.4770 waiting on mds.0 tid 2 (want 3) 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 16 ==== client_caps(flush_ack ino 0x1000000000f 1 seq 2 tid 2 caps=pAsXsFsc dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f51800775b0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 mds.0 seq now 5 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 5 client.4770 handle_cap_flush_ack mds.0 cleaned Fw on 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) with Fw 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 5 client.4770 flushing_caps Fw -> - 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) !flushing 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 20 client.4770 put_inode on 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) n = 1 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size was 0+3 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 20 client.4770 trim_cache size 0 max 16384 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size still 0+3 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 wait_sync_caps want 3 (last is 3, 1 total flushing) 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 waiting on mds.0 tid 3 (want 3) 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 17 ==== client_caps(flush_ack ino 0x10000000010 1 seq 2 tid 3 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f5180077ad0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 mds.0 seq now 6 2024-04-25T10:35:24.197 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 5 client.4770 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) with Fw 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 5 client.4770 flushing_caps Fw -> - 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) !flushing 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 20 client.4770 put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) n = 1 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size was 0+3 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 20 client.4770 trim_cache size 0 max 16384 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size still 0+3 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 wait_sync_caps want 3 (last is 3, 0 total flushing) 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 20 client.4770 trim_cache size 0 max 16384 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 _put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) n = 32 2024-04-25T10:35:24.198 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 15 client.4770 remove_cap last one, closing snaprealm 0x7f515c00bab0 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 3 -> 2 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=- has_dir_layout 0x7f515c00bba0) 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 _put_inode on 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) n = 26 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 remove_cap mds.0 on 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 15 client.4770 remove_cap last one, closing snaprealm 0x7f515c00bab0 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 2 -> 1 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 _put_inode deleting 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:23.950520+0000 mtime=2024-04-25T10:35:23.955084+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=- objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c180) 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 _put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) n = 16 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 remove_cap mds.0 on 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 15 client.4770 remove_cap last one, closing snaprealm 0x7f515c00bab0 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 20 client.4770 put_snap_realm 0x1 0x7f515c00bab0 1 -> 0 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 10 client.4770 _put_inode deleting 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-04-25T10:35:23.955580+0000 mtime=2024-04-25T10:35:23.956523+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=1 caps=- objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f515c00c760) 2024-04-25T10:35:24.199 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 2 client.4770 _close_mds_session mds.0 seq 6 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 6) -- 0x55fa3adf2990 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.963+0000 7f518d909480 2 client.4770 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 <== mds.0 v2:172.21.15.103:6834/2389441335 18 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ad78230 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 10 client.4770 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 5 client.4770 _closed_mds_session mds.0 seq 6 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 1 -- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 msgr2=0x55fa3adf7690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 0x55fa3adf7690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 10 client.4770 remove_session_caps mds.0 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 10 client.4770 kick_requests_closed for mds.0 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size was 0+0 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 20 client.4770 trim_cache size 0 max 16384 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.975+0000 7f5184bce640 10 client.4770 unmounting: trim pass, size still 0+0 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.982+0000 7f518d909480 2 client.4770 unmounted. 2024-04-25T10:35:24.200 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.982+0000 7f518d909480 1 client.4770 shutdown 2024-04-25T10:35:24.201 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameRenameExistMatch (43 ms) 2024-04-25T10:35:24.201 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameRenameExistMisMatch 2024-04-25T10:35:24.222 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.984+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3ae0cb60 msgr2=0x55fa3ae9e090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.222 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.984+0000 7f518d909480 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3ae0cb60 0x55fa3ae9e090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.222 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.984+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3aec5ad0 msgr2=0x55fa3aec7ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.222 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.984+0000 7f518d909480 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3aec5ad0 0x55fa3aec7ef0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.222 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.984+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3adf4320 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.984+0000 7f518d909480 1 --2- 172.21.15.103:0/3183989606 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3adf4320 0x55fa3aeb8fa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f517c00b010 tx=0x7f517c041040 comp rx=0 tx=0).stop 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.985+0000 7f5187bd4640 1 -- 172.21.15.103:0/3183989606 reap_dead start 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.985+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 shutdown_connections 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.985+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 >> 172.21.15.103:0/3183989606 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.986+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 shutdown_connections 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.986+0000 7f518d909480 1 -- 172.21.15.103:0/3183989606 wait complete. 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.986+0000 7f518d909480 20 client.4770 trim_cache size 0 max 16384 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.988+0000 7f518d909480 1 -- start start 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7e480 0x55fa3ad38280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7e480 0x55fa3ad38280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f51873d3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7e480 0x55fa3ad38280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50640/0 (socket says 172.21.15.103:50640) 2024-04-25T10:35:24.223 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f51873d3640 1 -- 172.21.15.103:0/1231871724 learned_addr learned my addr 172.21.15.103:0/1231871724 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad82920 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4320 0x55fa3adf7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c006d40 con 0x55fa3ad7e480 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3aec0490 con 0x55fa3adf4320 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3ad80380 con 0x55fa3ad82920 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad82920 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.990+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4320 0x55fa3adf7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.991+0000 7f5187bd4640 1 -- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad82920 msgr2=0x55fa3aeb8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.991+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3ad82920 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.991+0000 7f5187bd4640 1 -- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7e480 msgr2=0x55fa3ad38280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.991+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7e480 0x55fa3ad38280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.991+0000 7f5187bd4640 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae00630 con 0x55fa3adf4320 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.991+0000 7f51873d3640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3ad7e480 0x55fa3ad38280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5187bd4640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4320 0x55fa3adf7690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f517800c1d0 tx=0x7f5178047000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c62740195e18b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.224 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f518d909480 10 client.4648 Subscribing to map 'mdsmap' 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mdsmap=0+}) -- 0x55fa3ae06130 con 0x55fa3adf4320 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5175ffb640 20 client.4648 tick 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5175ffb640 20 client.4648 collect_and_send_metrics 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5175ffb640 20 client.4648 collect_and_send_global_metrics 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5175ffb640 5 client.4648 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5175ffb640 20 client.4648 trim_cache size 0 max 16384 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5175ffb640 20 client.4648 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5185bd0640 10 client.4648 ms_handle_connect on v2:172.21.15.132:3300/0 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.992+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517805e040 con 0x55fa3adf4320 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517802a040 con 0x55fa3adf4320 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178030b60 con 0x55fa3adf4320 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f5185bd0640 1 client.4648 handle_mds_map epoch 6 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f518d909480 20 client.4648 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:24.225 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f518d909480 10 client.4648 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f518d909480 20 client.4648 mds is 0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f518d909480 10 client.4648 _open_mds_session mds.0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3ad7b420 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f518d909480 10 client.4648 waiting for session to mds.0 to open 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.993+0000 7f51873d3640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.994+0000 7f51873d3640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 0x55fa3ad7add0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce9dfc7a91e10f56 server_cookie=ee11c095e6b233b2 in_seq=0 out_seq=0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:23.994+0000 7f5185bd0640 10 client.4648 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3ad7b420 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f5185bd0640 10 client.4648 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f5185bd0640 10 client.4648 renew_caps mds.0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f517000b640 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f5185bd0640 10 client.4648 connect_mds_targets for mds.0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f518d909480 10 client.4648 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.226 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f518d909480 20 client.4648 mds is 0 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f518d909480 10 client.4648 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f518d909480 20 client.4648 encode_cap_releases enter (req: 0x55fa3aeb1260, mds: 0) 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f518d909480 20 client.4648 send_request set sent_stamp to 2024-04-25T10:35:24.003605+0000 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f518d909480 10 client.4648 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.993700+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:23.993700+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adfdf90 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.003+0000 7f518d909480 20 client.4648 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f517000b640 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f51800bd040 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 insert_trace from 2024-04-25T10:35:24.003605+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 features 0xffffffffffffffff 2024-04-25T10:35:24.227 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 update_snap_trace len 70 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref now is 1 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 15 client.4648 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 15 client.4648 snapc 1=[] 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 put_snap_realm 0x1 0x7f517000b860 2 -> 1 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 hrm is_target=1 is_dentry=0 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f517000c590) - ctime 2024-04-25T10:35:23.956853+0000 mtime 2024-04-25T10:35:23.956853+0000 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 dir hash is 2 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 12 client.4648 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 32 2024-04-25T10:35:24.228 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 12 client.4648 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=- has_dir_layout 0x7f517000c590) caps pAsLsXsFs 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref was 1 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref now is 2 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 15 client.4648 add_update_cap first one, opened snaprealm 0x7f517000b860 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 put_snap_realm 0x1 0x7f517000b860 2 -> 1 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 handle_client_reply awaiting kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 sendrecv kickback on tid 1 0x7f5185bcddf0 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 lat 0.001027 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 _ll_get 0x7f517000c590 0x1 -> 1 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 3 client.4648 openat enter(AlternateNameRenameExistMisMatch_43224) 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.229 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 path_walk AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 (path is AlternateNameRenameExistMisMatch_43224) 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 _getattr mask As issued=1 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 3 client.4648 may_lookup 0x7f517000c590 = 0 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 _do_lookup on #0x1/AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_43224 => 1779099675 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) is_hash=1 hash=1779099675 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 mds is 0 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 encode_cap_releases enter (req: 0x55fa3adfdf90, mds: 0) 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 send_request set sent_stamp to 2024-04-25T10:35:24.004746+0000 2024-04-25T10:35:24.230 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.004715+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.004715+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad7a360 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 awaiting reply|forward|kick on 0x7ffc16ba7610 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f518005ea00 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 insert_trace from 2024-04-25T10:35:24.004746+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 10 client.4648 insert_trace -- no trace 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 handle_client_reply signalling caller 0x7ffc16ba7610 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f5185bd0640 20 client.4648 handle_client_reply awaiting kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 sendrecv kickback on tid 2 0x7f5185bcddf0 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 lat 0.000726 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 _do_lookup res is -2 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 10 client.4648 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) AlternateNameRenameExistMisMatch_43224 = -2 2024-04-25T10:35:24.231 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.004+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 10 client.4648 path_walk 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 10 client.4648 _getattr mask As issued=1 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 3 client.4648 may_create 0x7f517000c590 = 0 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 8 client.4648 _create(0x1 AlternateNameRenameExistMisMatch_43224, 0777) 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) name AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 15 open_dir 0x55fa3ad7b790 on 0x7f517000c590 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 15 client.4648 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) 'AlternateNameRenameExistMisMatch_43224' dn 0x1.head["AlternateNameRenameExistMisMatch_43224"] (new dn) 2024-04-25T10:35:24.232 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_43224 => 1779099675 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) is_hash=1 hash=1779099675 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 10 client.4648 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 mds is 0 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 10 client.4648 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 encode_cap_releases enter (req: 0x55fa3ad7a360, mds: 0) 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 encode_dentry_release enter(dn:0x7f515c00b9c0) 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000c590), req:0x55fa3ad7a360 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 send_request set sent_stamp to 2024-04-25T10:35:24.005572+0000 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 10 client.4648 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMisMatch_43224 (foo) 2024-04-25T10:35:24.005542+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMisMatch_43224 (foo) 2024-04-25T10:35:24.005542+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ad79130 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f518d909480 20 client.4648 awaiting reply|forward|kick on 0x7ffc16ba78d0 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.005+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 862+0+0 (crc 0 0 0) 0x7f518001a130 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.233 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 insert_trace from 2024-04-25T10:35:24.005572+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 features 0xffffffffffffffff 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 update_snap_trace len 70 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref was 1 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref now is 2 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) - ctime 2024-04-25T10:35:24.005542+0000 mtime 2024-04-25T10:35:24.005542+0000 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 12 client.4648 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 12 client.4648 add_update_inode adding 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=- objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref was 2 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref now is 3 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 15 client.4648 add_update_cap first one, opened snaprealm 0x7f517000b860 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) 2024-04-25T10:35:24.234 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 12 client.4648 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) caps pAsLsXs 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:23.956853+0000 ctime=2024-04-25T10:35:23.956853+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) pAsLsXs ctime 2024-04-25T10:35:24.005542+0000 mtime 2024-04-25T10:35:24.005542+0000 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 dir hash is 2 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 12 client.4648 add_update_inode client inode change_attr: 32 , mds inodestat change_attr: 33 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 12 client.4648 insert_dentry_inode 'AlternateNameRenameExistMisMatch_43224' vino 0x10000000205.head in dir 0x1.head dn 0x7f515c00b9c0 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 15 client.4648 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 'AlternateNameRenameExistMisMatch_43224' to inode 0x7f517000cb70 dn 0x1.head["AlternateNameRenameExistMisMatch_43224"] (old dn) 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 link inode 0x7f517000cb70 parents now 0x1.head["AlternateNameRenameExistMisMatch_43224"] 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 15 client.4648 update_dentry_lease 0x1.head["AlternateNameRenameExistMisMatch_43224"] lease(mask 7 dur 30000 altn foo)) from 2024-04-25T10:35:24.005572+0000 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 10 client.4648 got dentry lease on AlternateNameRenameExistMisMatch_43224 dur 30000ms ttl 2024-04-25T10:35:54.005572+0000 2024-04-25T10:35:24.235 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 put_snap_realm 0x1 0x7f517000b860 3 -> 2 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 handle_client_reply signalling caller 0x7ffc16ba78d0 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 handle_client_reply awaiting kickback on tid 3 0x7f5185bcddf0 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 20 client.4648 sendrecv kickback on tid 3 0x7f5185bcddf0 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 10 client.4648 delegated_inos: [] 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 10 client.4648 make_request created ino 0x10000000205 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 20 client.4648 make_request target is 0x10000000205.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 20 client.4648 lat 0.007544 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000205.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000205.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 10 client.4648 _create_fh 0x10000000205 mode 2 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 20 client.4648 trim_cache size 1 max 16384 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 8 client.4648 create(#0x1/AlternateNameRenameExistMisMatch_43224, 0100777 layout 0 0 0) = 0 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.236 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 3 client.4648 openat exit(AlternateNameRenameExistMisMatch_43224) 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 10 client.4648 get_quota_root realm 0x1 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 10 client.4648 get_quota_root 0x10000000205.head -> 0x1.head 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 10 client.4648 cur file size is 0 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aec87d0 0x55fa3aebfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- osd_op(unknown.0.0:1 3.3d 3:bfcd3380:::10000000205.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ae03b20 con 0x55fa3aec87d0 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- osd_op(unknown.0.0:2 3.3d 3:bfcd3380:::10000000205.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ad786e0 con 0x55fa3aec87d0 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.012+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aec87d0 0x55fa3aebfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.013+0000 7f5185bd0640 10 client.4648 ms_handle_connect on v2:172.21.15.103:6808/1654732884 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.013+0000 7f5186bd2640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aec87d0 0x55fa3aebfb20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=825079da59a0183a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.237 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.013+0000 7f5186bd2640 1 -- 172.21.15.103:0/1231871724 <== osd.0 v2:172.21.15.103:6808/1654732884 1 ==== osd_op_reply(1 10000000205.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3aec87d0 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f5186bd2640 1 -- 172.21.15.103:0/1231871724 <== osd.0 v2:172.21.15.103:6808/1654732884 2 ==== osd_op_reply(2 10000000205.00000000 [create] v23'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3aec87d0 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 wanted_max_size 0 -> 3 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 get_caps 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 clear_suid_sgid 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 5 client.4648 get_cap_ref got first FILE_BUFFER ref on 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 5 client.4648 get_cap_ref got first FILE_CACHE ref on 0x10000000205.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 mark_caps_dirty 0x10000000205.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) - -> Fw 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 cap_delay_requeue on 0x10000000205.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 get_quota_root realm 0x1 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 get_quota_root 0x10000000205.head -> 0x1.head 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 7 client.4648 wrote to 3, extending file size 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 mark_caps_dirty 0x10000000205.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) Fw -> Fw 2024-04-25T10:35:24.238 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 cap_delay_requeue on 0x10000000205.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 3 client.4648 write(10, "...", 3, 0) = 3 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 3 client.4648 close enter(10) 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 8 client.4648 _release_fh 0x55fa3ad7efb0 mode 2 on 0x10000000205.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 _flush 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- osd_op(unknown.0.0:3 3.3d 3:bfcd3380:::10000000205.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ae03ee0 con 0x55fa3aec87d0 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 check_caps on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 delaying cap release 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 cap_delay_requeue on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 _release_fh 0x55fa3ad7efb0 on inode 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) no async_err state 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 3 client.4648 close exit(10) 2024-04-25T10:35:24.239 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 3 client.4648 openat enter(AlternateNameRenameExistMisMatch_432242) 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 path_walk cur=0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 path_walk AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 0 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 (path is AlternateNameRenameExistMisMatch_432242) 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 may_lookup 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 _getattr mask As issued=1 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 3 client.4648 may_lookup 0x7f517000c590 = 0 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 _do_lookup on #0x1/AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_432242 => 3099559636 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 choose_target_mds 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) is_hash=1 hash=3099559636 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 mds is 0 2024-04-25T10:35:24.240 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 send_request rebuilding request 4 for mds.0 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 encode_cap_releases enter (req: 0x55fa3ad79130, mds: 0) 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 send_request set sent_stamp to 2024-04-25T10:35:24.015242+0000 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 10 client.4648 send_request client_request(unknown.0:4 lookup #0x1/AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.015228+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:4 lookup #0x1/AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.015228+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aec8be0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f518d909480 20 client.4648 awaiting reply|forward|kick on 0x7ffc16ba7610 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.014+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_reply(???:4 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f5180000bc0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 handle_client_reply got a reply. Safe:1 tid 4 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 insert_trace from 2024-04-25T10:35:24.015242+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 insert_trace -- no trace 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 handle_client_reply signalling caller 0x7ffc16ba7610 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 handle_client_reply awaiting kickback on tid 4 0x7f5185bcddf0 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 sendrecv kickback on tid 4 0x7f5185bcddf0 2024-04-25T10:35:24.241 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 lat 0.000272 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 _do_lookup res is -2 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 _lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) AlternateNameRenameExistMisMatch_432242 = -2 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 path_walk cur=0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 path_walk 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 may_create 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 _getattr mask As issued=1 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 3 client.4648 may_create 0x7f517000c590 = 0 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 8 client.4648 _create(0x1 AlternateNameRenameExistMisMatch_432242, 0777) 2024-04-25T10:35:24.242 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 get_or_create 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) name AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 15 client.4648 link dir 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 'AlternateNameRenameExistMisMatch_432242' dn 0x1.head["AlternateNameRenameExistMisMatch_432242"] (new dn) 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_432242 => 3099559636 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 choose_target_mds 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) is_hash=1 hash=3099559636 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 choose_target_mds from dirfragtree hash 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 mds is 0 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 send_request rebuilding request 5 for mds.0 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 encode_cap_releases enter (req: 0x55fa3aec8be0, mds: 0) 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 encode_dentry_release enter(dn:0x55fa3aca4fd0) 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590), req:0x55fa3aec8be0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 send_request set sent_stamp to 2024-04-25T10:35:24.015626+0000 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 send_request client_request(unknown.0:5 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMisMatch_432242 (foomismatch) 2024-04-25T10:35:24.015597+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:5 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMisMatch_432242 (foomismatch) 2024-04-25T10:35:24.015597+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aea3c80 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 awaiting reply|forward|kick on 0x7ffc16ba78d0 2024-04-25T10:35:24.243 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:5 = 0 (0) Success unsafe) ==== 887+0+0 (crc 0 0 0) 0x7f51800620d0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 handle_client_reply got a reply. Safe:0 tid 5 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 insert_trace from 2024-04-25T10:35:24.015626+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 features 0xffffffffffffffff 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 update_snap_trace len 70 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref was 2 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref now is 3 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) - ctime 2024-04-25T10:35:24.015597+0000 mtime 2024-04-25T10:35:24.015597+0000 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 12 client.4648 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 12 client.4648 add_update_inode adding 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=- objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref was 3 2024-04-25T10:35:24.244 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref now is 4 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 15 client.4648 add_update_cap first one, opened snaprealm 0x7f517000b860 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 12 client.4648 add_update_inode had 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) caps pAsLsXs 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.005542+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) pAsLsXs ctime 2024-04-25T10:35:24.015597+0000 mtime 2024-04-25T10:35:24.005542+0000 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 dir hash is 2 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 12 client.4648 add_update_inode client inode change_attr: 33 , mds inodestat change_attr: 34 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 12 client.4648 insert_dentry_inode 'AlternateNameRenameExistMisMatch_432242' vino 0x10000000206.head in dir 0x1.head dn 0x55fa3aca4fd0 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 15 client.4648 link dir 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 'AlternateNameRenameExistMisMatch_432242' to inode 0x7f517000d150 dn 0x1.head["AlternateNameRenameExistMisMatch_432242"] (old dn) 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 link inode 0x7f517000d150 parents now 0x1.head["AlternateNameRenameExistMisMatch_432242"] 2024-04-25T10:35:24.245 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 15 client.4648 update_dentry_lease 0x1.head["AlternateNameRenameExistMisMatch_432242"] lease(mask 7 dur 30000 altn foomismatch)) from 2024-04-25T10:35:24.015626+0000 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 10 client.4648 got dentry lease on AlternateNameRenameExistMisMatch_432242 dur 30000ms ttl 2024-04-25T10:35:54.015626+0000 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 put_snap_realm 0x1 0x7f517000b860 4 -> 3 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 handle_client_reply signalling caller 0x7ffc16ba78d0 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f5185bd0640 20 client.4648 handle_client_reply awaiting kickback on tid 5 0x7f5185bcddf0 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 sendrecv kickback on tid 5 0x7f5185bcddf0 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 delegated_inos: [0x10000000207~0x1f4] 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 make_request created ino 0x10000000206 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 make_request target is 0x10000000206.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 lat 0.000785 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000206.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000206.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.246 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 _create_fh 0x10000000206 mode 2 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 trim_cache size 2 max 16384 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 8 client.4648 create(#0x1/AlternateNameRenameExistMisMatch_432242, 0100777 layout 0 0 0) = 0 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 3 client.4648 openat exit(AlternateNameRenameExistMisMatch_432242) 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 get_quota_root realm 0x1 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 get_quota_root 0x10000000206.head -> 0x1.head 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 cur file size is 0 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 wanted_max_size 0 -> 3 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 get_caps 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 20 client.4648 clear_suid_sgid 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:24.247 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 client.4648 snaprealm snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 5 client.4648 get_cap_ref got first FILE_BUFFER ref on 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 5 client.4648 get_cap_ref got first FILE_CACHE ref on 0x10000000206.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.015+0000 7f518d909480 10 mark_caps_dirty 0x10000000206.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) - -> Fw 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 cap_delay_requeue on 0x10000000206.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 get_quota_root realm 0x1 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 get_quota_root 0x10000000206.head -> 0x1.head 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 7 client.4648 wrote to 3, extending file size 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 mark_caps_dirty 0x10000000206.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) Fw -> Fw 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 cap_delay_requeue on 0x10000000206.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 3 client.4648 write(10, "...", 3, 0) = 3 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 3 client.4648 close enter(10) 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 8 client.4648 _release_fh 0x55fa3ad7efb0 mode 2 on 0x10000000206.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 _flush 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.248 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3aec7fa0 0x55fa3ae9d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] -- osd_op(unknown.0.0:4 3.0 3:012cdbc7:::10000000206.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ae9db40 con 0x55fa3aec7fa0 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 check_caps on 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 delaying cap release 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 cap_delay_requeue on 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 _release_fh 0x55fa3ad7efb0 on inode 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) no async_err state 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f51873d3640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3aec7fa0 0x55fa3ae9d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 3 client.4648 close exit(10) 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 path_walk cur=0x1.head(faked_ino=0 nref=26 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 path_walk 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 path_walk cur=0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 path_walk 2024-04-25T10:35:24.249 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 may_delete 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590); ; name AlternateNameRenameExistMisMatch_43224; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 _getattr mask As issued=1 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 3 client.4648 may_delete 0x7f517000c590 = 0 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 may_delete 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590); ; name AlternateNameRenameExistMisMatch_432242; UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 _getattr mask As issued=1 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 3 client.4648 may_delete 0x7f517000c590 = 0 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 8 client.4648 _rename(0x1 AlternateNameRenameExistMisMatch_43224 to 0x1 AlternateNameRenameExistMisMatch_432242 uid 0 gid 0) 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 get_or_create 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) name AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 get_or_create 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) name AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_43224"] from mds.0 ttl 2024-04-25T10:35:54.005572+0000 seq 2 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 _lookup 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) AlternateNameRenameExistMisMatch_43224 = 0x10000000205.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000205.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000205.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_432242"] from mds.0 ttl 2024-04-25T10:35:54.015626+0000 seq 3 2024-04-25T10:35:24.250 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 _lookup 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) AlternateNameRenameExistMisMatch_432242 = 0x10000000206.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_432242 => 3099559636 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 choose_target_mds 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) is_hash=1 hash=3099559636 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 choose_target_mds from dirfragtree hash 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 mds is 0 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 send_request rebuilding request 6 for mds.0 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 encode_cap_releases enter (req: 0x55fa3aea3c80, mds: 0) 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 encode_inode_release enter(in:0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70), req:0x55fa3aea3c80 mds:0, drop:Ls, unless:-, force:0) 2024-04-25T10:35:24.251 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 encode_inode_release enter(in:0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150), req:0x55fa3aea3c80 mds:0, drop:Lsx, unless:-, force:0) 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 encode_dentry_release enter(dn:0x55fa3aca4fd0) 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590), req:0x55fa3aea3c80 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 encode_dentry_release enter(dn:0x7f515c00b9c0) 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590), req:0x55fa3aea3c80 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 send_request set sent_stamp to 2024-04-25T10:35:24.016868+0000 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 10 client.4648 send_request client_request(unknown.0:6 rename #0x1/AlternateNameRenameExistMisMatch_432242 (foo2) #0x1/AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.016834+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:6 rename #0x1/AlternateNameRenameExistMisMatch_432242 (foo2) #0x1/AlternateNameRenameExistMisMatch_43224 2024-04-25T10:35:24.016834+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf0950 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f518d909480 20 client.4648 awaiting reply|forward|kick on 0x7ffc16ba7ac0 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f51873d3640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3aec7fa0 0x55fa3ae9d600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=7c350c128c84bc7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 ms_handle_connect on v2:172.21.15.103:6816/1963339576 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(revoke ino 0x10000000205 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.005542+0000 ctime 2024-04-25T10:35:24.005542+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f5180062610 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 5 client.4648 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 mds.0 seq now 1 2024-04-25T10:35:24.252 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 5 client.4648 handle_cap_grant on in 0x10000000205 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:24.005542+0000 mtime 2024-04-25T10:35:24.005542+0000 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 revocation of AxXx 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 check_caps on 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 completed revocation of AxXx 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 mark_caps_flushing Fw 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 mark_caps_clean 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 send_cap 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 15 client.4648 auth cap, requesting max_size 3 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000205 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.015134+0000 ctime 2024-04-25T10:35:24.015134+0000 change_attr 1) -- 0x7f517000d730 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_caps(revoke ino 0x10000000206 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.015597+0000 ctime 2024-04-25T10:35:24.015597+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f518000a1b0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 mds.0 seq now 2 2024-04-25T10:35:24.253 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 5 client.4648 handle_cap_grant on in 0x10000000206 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:24.015597+0000 mtime 2024-04-25T10:35:24.015597+0000 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 revocation of AxXx 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 check_caps on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 completed revocation of AxXx 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 client.4648 mark_caps_flushing Fw 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.016+0000 7f5185bd0640 10 mark_caps_clean 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 10 client.4648 send_cap 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 15 client.4648 auth cap, requesting max_size 3 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000206 1 seq 2 tid 3 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.016506+0000 ctime 2024-04-25T10:35:24.016506+0000 change_attr 1) -- 0x7f5180062610 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 10 client.4648 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_reply(???:6 = -22 (22) Invalid argument safe) ==== 27+0+0 (crc 0 0 0) 0x7f5180077960 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 20 client.4648 handle_client_reply got a reply. Safe:1 tid 6 2024-04-25T10:35:24.254 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 10 client.4648 insert_trace from 2024-04-25T10:35:24.016868+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 10 client.4648 insert_trace -- no trace 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 20 client.4648 handle_client_reply signalling caller 0x7ffc16ba7ac0 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 20 client.4648 handle_client_reply awaiting kickback on tid 6 0x7f5185bcddf0 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 sendrecv kickback on tid 6 0x7f5185bcddf0 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 lat 0.000957 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 rename result is -22 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 trim_cache size 2 max 16384 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 8 client.4648 _rename(#0x1/AlternateNameRenameExistMisMatch_43224, #0x1/AlternateNameRenameExistMisMatch_432242) = -22 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 walk: AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.255 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 path_walk cur=0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 path_walk AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 0 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 (path is AlternateNameRenameExistMisMatch_432242) 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 may_lookup 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 _getattr mask As issued=1 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 3 client.4648 may_lookup 0x7f517000c590 = 0 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_432242"] from mds.-1 ttl 2024-04-25T10:35:54.015626+0000 seq 3 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 _do_lookup on #0x1/AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_432242 => 3099559636 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 choose_target_mds 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) is_hash=1 hash=3099559636 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 mds is 0 2024-04-25T10:35:24.256 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 send_request rebuilding request 7 for mds.0 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 encode_cap_releases enter (req: 0x55fa3adf0950, mds: 0) 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 send_request set sent_stamp to 2024-04-25T10:35:24.017952+0000 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 10 client.4648 send_request client_request(unknown.0:7 lookup #0x1/AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.017928+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:7 lookup #0x1/AlternateNameRenameExistMisMatch_432242 2024-04-25T10:35:24.017928+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf0e80 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f5186bd2640 1 -- 172.21.15.103:0/1231871724 <== osd.0 v2:172.21.15.103:6808/1654732884 3 ==== osd_op_reply(3 10000000205.00000000 [write 0~3] v23'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3aec87d0 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f518d909480 20 client.4648 awaiting reply|forward|kick on 0x7ffc16ba7920 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f51777fe640 10 client.4648 _flushed 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f51777fe640 5 client.4648 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f51777fe640 5 client.4648 put_cap_ref dropped last FILE_CACHE ref on 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f51777fe640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 2 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.017+0000 7f51777fe640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_43224"] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.019+0000 7f51873d3640 1 -- 172.21.15.103:0/1231871724 <== osd.1 v2:172.21.15.103:6816/1963339576 1 ==== osd_op_reply(4 10000000206.00000000 [write 0~3] v23'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f518007d070 con 0x55fa3aec7fa0 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.019+0000 7f51777fe640 10 client.4648 _flushed 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.257 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.019+0000 7f51777fe640 5 client.4648 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.019+0000 7f51777fe640 5 client.4648 put_cap_ref dropped last FILE_CACHE ref on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.019+0000 7f51777fe640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 2 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.019+0000 7f51777fe640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_caps(grant ino 0x10000000206 1 seq 3 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 3/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.016506+0000 ctime 2024-04-25T10:35:24.016506+0000 change_attr 1) ==== 260+0+0 (crc 0 0 0) 0x7f5180062610 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 mds.0 seq now 3 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 5 client.4648 handle_cap_grant on in 0x10000000206 mds.0 seq 3 caps now pAsXsFsxcrwb was pAsXsFsxcrwb 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) pAsXsFsxcrwb ctime 2024-04-25T10:35:24.016506+0000 mtime 2024-04-25T10:35:24.016506+0000 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 caps unchanged at pAsXsFsxcrwb 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 12 ==== client_reply(???:7 = 0 (0) Success) ==== 849+0+0 (crc 0 0 0) 0x7f5180077cc0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 handle_client_reply got a reply. Safe:1 tid 7 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 insert_trace from 2024-04-25T10:35:24.017952+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 features 0xffffffffffffffff 2024-04-25T10:35:24.258 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 update_snap_trace len 70 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref was 3 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 get_snap_realm 0x1 0x7f517000b860, nref now is 4 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 12 client.4648 add_update_inode had 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) caps pAsLsXsFsxcrwb 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) pAsXsFsxcrwb ctime 2024-04-25T10:35:24.016506+0000 mtime 2024-04-25T10:35:24.016506+0000 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 12 client.4648 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 1 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 add_update_cap issued pAsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x10000000206.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 12 client.4648 add_update_inode had 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) caps pAsLsXs 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 update_inode_file_time 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.005542+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) pAsLsXs ctime 2024-04-25T10:35:24.015597+0000 mtime 2024-04-25T10:35:24.015597+0000 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 dir hash is 2 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 12 client.4648 add_update_inode client inode change_attr: 34 , mds inodestat change_attr: 34 2024-04-25T10:35:24.259 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 12 client.4648 insert_dentry_inode 'AlternateNameRenameExistMisMatch_432242' vino 0x10000000206.head in dir 0x1.head dn 0x55fa3aca4fd0 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 12 client.4648 had dentry AlternateNameRenameExistMisMatch_432242 with correct vino 0x10000000206.head 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 15 client.4648 update_dentry_lease 0x1.head["AlternateNameRenameExistMisMatch_432242"] lease(mask 7 dur 30000 altn foomismatch)) from 2024-04-25T10:35:24.017952+0000 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 got dentry lease on AlternateNameRenameExistMisMatch_432242 dur 30000ms ttl 2024-04-25T10:35:54.017952+0000 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_snap_realm 0x1 0x7f517000b860 4 -> 3 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 handle_client_reply signalling caller 0x7ffc16ba7920 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 handle_client_reply awaiting kickback on tid 7 0x7f5185bcddf0 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 sendrecv kickback on tid 7 0x7f5185bcddf0 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 make_request target is 0x10000000206.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 lat 0.003005 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _do_lookup res is 0 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_432242"] from mds.0 ttl 2024-04-25T10:35:54.017952+0000 seq 4 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.260 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _lookup 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) AlternateNameRenameExistMisMatch_432242 = 0x10000000206.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 2 client.4648 unmount 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 unmounting: trim pass, size was 2+3 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 trim_cache size 2 max 16384 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 15 client.4648 trim_dentry unlinking dn AlternateNameRenameExistMisMatch_43224 in dir 0x1 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 15 client.4648 unlink dir 0x7f517000c590 'AlternateNameRenameExistMisMatch_43224' dn 0x7f515c00b9c0 inode 0x7f517000cb70 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 unlink inode 0x7f517000cb70 parents now 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 15 client.4648 unlink removing 'AlternateNameRenameExistMisMatch_43224' dn 0x7f515c00b9c0 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.261 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 2 client.4648 unmounting 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3ad77560 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 13 ==== client_reply(???:5 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f5180098470 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 waiting for write request '5' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 handle_client_reply got a reply. Safe:1 tid 5 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 insert_trace from 2024-04-25T10:35:24.015626+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_432242"] 0x7f517000d150) n = 1 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 unmounting: trim pass, size was 1+3 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 trim_cache size 1 max 16384 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 15 client.4648 trim_dentry unlinking dn AlternateNameRenameExistMisMatch_432242 in dir 0x1 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 15 client.4648 unlink dir 0x7f517000c590 'AlternateNameRenameExistMisMatch_432242' dn 0x55fa3aca4fd0 inode 0x7f517000d150 2024-04-25T10:35:24.262 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d150) n = 1 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 unlink inode 0x7f517000d150 parents now 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 15 client.4648 unlink removing 'AlternateNameRenameExistMisMatch_432242' dn 0x55fa3aca4fd0 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 15 client.4648 close_dir dir 0x55fa3ad7b790 on 0x7f517000c590 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d150) n = 1 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _ll_drop_pins 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 _ll_put 0x7f517000c590 0x1 1 -> 0 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=31 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=31 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 _release 0x10000000206.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d150) 2024-04-25T10:35:24.263 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 14 ==== client_caps(flush_ack ino 0x10000000205 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f517000d730 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _invalidate_inode_cache 0x10000000206.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000d150) 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _flush 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 nothing to flush 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) n = 1 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 _release 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000cb70) 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _invalidate_inode_cache 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] 0x7f517000cb70) 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _flush 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 nothing to flush 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 _release 0x1.head(faked_ino=0 nref=32 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=32 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _flush 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 nothing to flush 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.264 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) n = 1 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 1 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 flush_caps_sync 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 wait_sync_caps want 3 (last is 3, 2 total flushing) 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 waiting on mds.0 tid 2 (want 3) 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 mds.0 seq now 4 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 5 client.4648 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) with Fw 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 5 client.4648 flushing_caps Fw -> - 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) !flushing 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) n = 1 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 unmounting: trim pass, size was 0+3 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 trim_cache size 0 max 16384 2024-04-25T10:35:24.265 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 unmounting: trim pass, size still 0+3 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 wait_sync_caps want 3 (last is 3, 1 total flushing) 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 waiting on mds.0 tid 3 (want 3) 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 15 ==== client_caps(flush_ack ino 0x10000000206 1 seq 2 tid 3 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f51800986b0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 mds.0 seq now 5 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 5 client.4648 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) with Fw 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 5 client.4648 flushing_caps Fw -> - 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) !flushing 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 put_inode on 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) n = 1 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 unmounting: trim pass, size was 0+3 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 20 client.4648 trim_cache size 0 max 16384 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f5185bd0640 10 client.4648 unmounting: trim pass, size still 0+3 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 wait_sync_caps want 3 (last is 3, 0 total flushing) 2024-04-25T10:35:24.266 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 trim_cache size 0 max 16384 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) n = 32 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 15 client.4648 remove_cap last one, closing snaprealm 0x7f517000b860 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_snap_realm 0x1 0x7f517000b860 3 -> 2 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=- has_dir_layout 0x7f517000c590) 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _put_inode on 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) n = 16 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 remove_cap mds.0 on 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 15 client.4648 remove_cap last one, closing snaprealm 0x7f517000b860 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_snap_realm 0x1 0x7f517000b860 2 -> 1 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _put_inode deleting 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.005542+0000 mtime=2024-04-25T10:35:24.015134+0000 ctime=2024-04-25T10:35:24.015134+0000 change_attr=1 caps=- objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000cb70) 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _put_inode on 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) n = 20 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 remove_cap mds.0 on 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 15 client.4648 remove_cap last one, closing snaprealm 0x7f517000b860 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 20 client.4648 put_snap_realm 0x1 0x7f517000b860 1 -> 0 2024-04-25T10:35:24.267 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 10 client.4648 _put_inode deleting 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.015597+0000 mtime=2024-04-25T10:35:24.016506+0000 ctime=2024-04-25T10:35:24.016506+0000 change_attr=1 caps=- objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d150) 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 2 client.4648 _close_mds_session mds.0 seq 5 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 5) -- 0x55fa3aec7af0 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.020+0000 7f518d909480 2 client.4648 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 <== mds.0 v2:172.21.15.103:6834/2389441335 16 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3ad77560 con 0x55fa3ae9f9a0 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f5185bd0640 10 client.4648 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f5185bd0640 5 client.4648 _closed_mds_session mds.0 seq 5 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f5185bd0640 1 -- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 msgr2=0x55fa3ad7add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f5185bd0640 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ae9f9a0 0x55fa3ad7add0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f5185bd0640 10 client.4648 remove_session_caps mds.0 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f5185bd0640 10 client.4648 kick_requests_closed for mds.0 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f518d909480 2 client.4648 unmounted. 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f518d909480 1 client.4648 shutdown 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aec87d0 msgr2=0x55fa3aebfb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x55fa3aec87d0 0x55fa3aebfb20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.268 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3aec7fa0 msgr2=0x55fa3ae9d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x55fa3aec7fa0 0x55fa3ae9d600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f5187bd4640 1 -- 172.21.15.103:0/1231871724 reap_dead start 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4320 msgr2=0x55fa3adf7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.034+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4320 0x55fa3adf7690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f517800c1d0 tx=0x7f5178047000 comp rx=0 tx=0).stop 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.036+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 shutdown_connections 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.036+0000 7f518d909480 1 --2- 172.21.15.103:0/1231871724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3adf4320 0x55fa3adf7690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.036+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 >> 172.21.15.103:0/1231871724 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.039+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 shutdown_connections 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.039+0000 7f518d909480 1 -- 172.21.15.103:0/1231871724 wait complete. 2024-04-25T10:35:24.269 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.039+0000 7f518d909480 20 client.4648 trim_cache size 0 max 16384 2024-04-25T10:35:24.270 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameRenameExistMisMatch (53 ms) 2024-04-25T10:35:24.270 INFO:tasks.workunit.client.0.smithi103.stdout:[ RUN ] TestClient.AlternateNameLink 2024-04-25T10:35:24.280 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.040+0000 7f518d909480 1 -- start start 2024-04-25T10:35:24.280 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.042+0000 7f518d909480 1 Processor -- start 2024-04-25T10:35:24.280 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.042+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aec7fa0 0x55fa3ad38280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.280 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.042+0000 7f518d909480 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad82920 0x55fa3ae9e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.280 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.042+0000 7f518d909480 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.280 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.042+0000 7f518d909480 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5170003d30 con 0x55fa3aeb1180 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.042+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55fa3ae04960 con 0x55fa3ad82920 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.042+0000 7f518d909480 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x55fa3adf3f40 con 0x55fa3aec7fa0 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5187bd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50652/0 (socket says 172.21.15.103:50652) 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5187bd4640 1 -- 172.21.15.103:0/2347418370 learned_addr learned my addr 172.21.15.103:0/2347418370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5187bd4640 1 -- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aec7fa0 msgr2=0x55fa3ad38280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55fa3aec7fa0 0x55fa3ad38280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5187bd4640 1 -- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad82920 msgr2=0x55fa3ae9e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad82920 0x55fa3ae9e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad82920 0x55fa3ae9e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.043+0000 7f5187bd4640 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa3ae00630 con 0x55fa3aeb1180 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fa3ad82920 0x55fa3ae9e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f5187bd4640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5178002010 tx=0x7f5178055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ad14ffc9ca2da9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f5184bce640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-04-25T10:35:24.281 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517805e070 con 0x55fa3aeb1180 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f518d909480 10 client.4776 Subscribing to map 'mdsmap' 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) -- 0x55fa3ae9e620 con 0x55fa3aeb1180 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f517802a040 con 0x55fa3aeb1180 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f51767fc640 20 client.4776 tick 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f51767fc640 20 client.4776 collect_and_send_metrics 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f51767fc640 20 client.4776 collect_and_send_global_metrics 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f51767fc640 5 client.4776 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f51767fc640 20 client.4776 trim_cache size 0 max 16384 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f51767fc640 20 client.4776 upkeep thread waiting interval 1.000000000s 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mon.0 v2:172.21.15.103:3300/0 3 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517800cd60 con 0x55fa3aeb1180 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mdsmap(e 6) ==== 1240+0+0 (secure 0 0 0) 0x7f5178024a70 con 0x55fa3aeb1180 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.044+0000 7f5184bce640 1 client.4776 handle_mds_map epoch 6 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f518d909480 20 client.4776 populate_metadata read hostname 'smithi103' 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f518d909480 10 client.4776 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.282 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f518d909480 20 client.4776 mds is 0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f518d909480 10 client.4776 _open_mds_session mds.0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f518d909480 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad801c0 0x55fa3ad7add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_open) -- 0x55fa3aea4070 con 0x55fa3ad801c0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f518d909480 10 client.4776 waiting for session to mds.0 to open 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f51873d3640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad801c0 0x55fa3ad7add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.045+0000 7f5184bce640 10 client.4776 ms_handle_connect on v2:172.21.15.103:6834/2389441335 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.046+0000 7f51873d3640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad801c0 0x55fa3ad7add0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf25e680e61e5cd server_cookie=6b0d6f9751fe3cb3 in_seq=0 out_seq=0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) ==== 113+0+0 (crc 0 0 0) 0x55fa3aea4070 con 0x55fa3ad801c0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f5184bce640 10 client.4776 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) from mds.0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f5184bce640 10 client.4776 renew_caps mds.0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_renewcaps seq 1) -- 0x7f517000ca40 con 0x55fa3ad801c0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f5184bce640 10 client.4776 connect_mds_targets for mds.0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f518d909480 10 client.4776 did not get mds through better means, so chose random mds 0 2024-04-25T10:35:24.283 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f518d909480 20 client.4776 mds is 0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f518d909480 10 client.4776 send_request rebuilding request 1 for mds.0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f518d909480 20 client.4776 encode_cap_releases enter (req: 0x55fa3ad7a3c0, mds: 0) 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f518d909480 20 client.4776 send_request set sent_stamp to 2024-04-25T10:35:24.067246+0000 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f518d909480 10 client.4776 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:24.045545+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-04-25T10:35:24.045545+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3adf0980 con 0x55fa3ad801c0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.066+0000 7f518d909480 20 client.4776 awaiting reply|forward|kick on 0x7ffc16ba7d40 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 2 ==== client_session(renewcaps seq 1) ==== 28+0+0 (crc 0 0 0) 0x7f517000ca40 con 0x55fa3ad801c0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 handle_client_session client_session(renewcaps seq 1) from mds.0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 3 ==== client_reply(???:1 = 0 (0) Success) ==== 431+0+0 (crc 0 0 0) 0x7f51800bd040 con 0x55fa3ad801c0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 handle_client_reply got a reply. Safe:1 tid 1 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 insert_trace from 2024-04-25T10:35:24.067246+0000 mds.0 is_target=1 is_dentry=0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 features 0xffffffffffffffff 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 update_snap_trace len 70 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0, nref was 0 2024-04-25T10:35:24.284 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref now is 1 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 15 client.4776 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) self|parent updated 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 15 client.4776 snapc 1=[] 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 put_snap_realm 0x1 0x7f517000cc60 2 -> 1 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 hrm is_target=1 is_dentry=0 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f517000cd50) - ctime 2024-04-25T10:35:24.015597+0000 mtime 2024-04-25T10:35:24.015597+0000 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 dir hash is 2 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 12 client.4776 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 34 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 12 client.4776 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=- has_dir_layout 0x7f517000cd50) caps pAsLsXsFs 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref was 1 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref now is 2 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 15 client.4776 add_update_cap first one, opened snaprealm 0x7f517000cc60 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.285 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 put_snap_realm 0x1 0x7f517000cc60 2 -> 1 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 handle_client_reply signalling caller 0x7ffc16ba7d40 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 handle_client_reply awaiting kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 sendrecv kickback on tid 1 0x7f5184bcbdf0 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 lat 0.000791 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 _ll_get 0x7f517000cd50 0x1 -> 1 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 3 client.4776 openat enter(AlternateNameLink_43224) 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 path_walk AlternateNameLink_43224 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) AlternateNameLink_43224 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 (path is AlternateNameLink_43224) 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 _getattr mask As issued=1 2024-04-25T10:35:24.286 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 3 client.4776 may_lookup 0x7f517000cd50 = 0 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 _do_lookup on #0x1/AlternateNameLink_43224 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 choose_target_mds inode dir hash is 2 on AlternateNameLink_43224 => 1330352703 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) is_hash=1 hash=1330352703 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 mds is 0 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 send_request rebuilding request 2 for mds.0 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 encode_cap_releases enter (req: 0x55fa3adf0980, mds: 0) 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 send_request set sent_stamp to 2024-04-25T10:35:24.068115+0000 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameLink_43224 2024-04-25T10:35:24.068089+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:2 lookup #0x1/AlternateNameLink_43224 2024-04-25T10:35:24.068089+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3ae9f9a0 con 0x55fa3ad801c0 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 awaiting reply|forward|kick on 0x7ffc16ba7630 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.287 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 4 ==== client_reply(???:2 = -2 (2) No such file or directory) ==== 27+0+0 (crc 0 0 0) 0x7f518005e3a0 con 0x55fa3ad801c0 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 handle_client_reply got a reply. Safe:1 tid 2 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 insert_trace from 2024-04-25T10:35:24.068115+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 10 client.4776 insert_trace -- no trace 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 handle_client_reply signalling caller 0x7ffc16ba7630 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f5184bce640 20 client.4776 handle_client_reply awaiting kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 sendrecv kickback on tid 2 0x7f5184bcbdf0 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 lat 0.000279 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 _do_lookup res is -2 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) AlternateNameLink_43224 = -2 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 path_walk 2024-04-25T10:35:24.288 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 10 client.4776 _getattr mask As issued=1 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 3 client.4776 may_create 0x7f517000cd50 = 0 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 8 client.4776 _create(0x1 AlternateNameLink_43224, 0777) 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.067+0000 7f518d909480 20 client.4776 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) name AlternateNameLink_43224 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 15 open_dir 0x55fa3aec8da0 on 0x7f517000cd50 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 15 client.4776 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) 'AlternateNameLink_43224' dn 0x1.head["AlternateNameLink_43224"] (new dn) 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 choose_target_mds inode dir hash is 2 on AlternateNameLink_43224 => 1330352703 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) is_hash=1 hash=1330352703 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 10 client.4776 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 mds is 0 2024-04-25T10:35:24.289 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 10 client.4776 send_request rebuilding request 3 for mds.0 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 encode_cap_releases enter (req: 0x55fa3ae9f9a0, mds: 0) 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 encode_dentry_release enter(dn:0x7f515c00bab0) 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f517000cd50), req:0x55fa3ae9f9a0 mds:0, drop:Fs, unless:Fx, force:1) 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 send_request set sent_stamp to 2024-04-25T10:35:24.068552+0000 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 10 client.4776 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameLink_43224 (foo) 2024-04-25T10:35:24.068519+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameLink_43224 (foo) 2024-04-25T10:35:24.068519+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aec7af0 con 0x55fa3ad801c0 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f518d909480 20 client.4776 awaiting reply|forward|kick on 0x7ffc16ba78f0 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.068+0000 7f5184bce640 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 5 ==== client_reply(???:3 = 0 (0) Success safe) ==== 847+0+0 (crc 0 0 0) 0x7f518005ea00 con 0x55fa3ad801c0 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 handle_client_reply got a reply. Safe:1 tid 3 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 insert_trace from 2024-04-25T10:35:24.068552+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 features 0xffffffffffffffff 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 update_snap_trace len 70 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref was 1 2024-04-25T10:35:24.290 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref now is 2 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d330) - ctime 2024-04-25T10:35:24.068519+0000 mtime 2024-04-25T10:35:24.068519+0000 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 12 client.4776 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 12 client.4776 add_update_inode adding 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=- objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d330) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref was 2 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref now is 3 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 15 client.4776 add_update_cap first one, opened snaprealm 0x7f517000cc60 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d330) 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 12 client.4776 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) caps pAsLsXs 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.015597+0000 ctime=2024-04-25T10:35:24.015597+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) pAsLsXs ctime 2024-04-25T10:35:24.068519+0000 mtime 2024-04-25T10:35:24.068519+0000 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 dir hash is 2 2024-04-25T10:35:24.291 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 12 client.4776 add_update_inode client inode change_attr: 34 , mds inodestat change_attr: 35 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 12 client.4776 insert_dentry_inode 'AlternateNameLink_43224' vino 0x10000000011.head in dir 0x1.head dn 0x7f515c00bab0 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 15 client.4776 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 'AlternateNameLink_43224' to inode 0x7f517000d330 dn 0x1.head["AlternateNameLink_43224"] (old dn) 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 link inode 0x7f517000d330 parents now 0x1.head["AlternateNameLink_43224"] 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 15 client.4776 update_dentry_lease 0x1.head["AlternateNameLink_43224"] lease(mask 7 dur 30000 altn foo)) from 2024-04-25T10:35:24.068552+0000 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 got dentry lease on AlternateNameLink_43224 dur 30000ms ttl 2024-04-25T10:35:54.068552+0000 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 put_snap_realm 0x1 0x7f517000cc60 3 -> 2 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 handle_client_reply signalling caller 0x7ffc16ba78f0 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 handle_client_reply awaiting kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:24.292 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 20 client.4776 sendrecv kickback on tid 3 0x7f5184bcbdf0 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 10 client.4776 delegated_inos: [] 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 10 client.4776 make_request created ino 0x10000000011 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 20 client.4776 make_request target is 0x10000000011.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 20 client.4776 lat 0.003115 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000011.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000011.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 10 client.4776 _create_fh 0x10000000011 mode 2 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 20 client.4776 trim_cache size 1 max 16384 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 8 client.4776 create(#0x1/AlternateNameLink_43224, 0100777 layout 0 0 0) = 0 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 3 client.4776 openat exit(AlternateNameLink_43224) 2024-04-25T10:35:24.293 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 10 client.4776 get_quota_root realm 0x1 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 10 client.4776 get_quota_root 0x10000000011.head -> 0x1.head 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 10 client.4776 cur file size is 0 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3adf4290 0x55fa3ad78090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- osd_op(unknown.0.0:1 3.15 3:ab5910e2:::10000000011.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ae0c6a0 con 0x55fa3adf4290 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- osd_op(unknown.0.0:2 3.15 3:ab5910e2:::10000000011.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3ae0ca60 con 0x55fa3adf4290 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3adf4290 0x55fa3ad78090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5184bce640 10 client.4776 ms_handle_connect on v2:172.21.15.132:6816/2222857157 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.071+0000 7f5186bd2640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3adf4290 0x55fa3ad78090 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=d7e5f92916fd6ecc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.072+0000 7f5186bd2640 1 -- 172.21.15.103:0/2347418370 <== osd.7 v2:172.21.15.132:6816/2222857157 1 ==== osd_op_reply(1 10000000011.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3adf4290 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f5186bd2640 1 -- 172.21.15.103:0/2347418370 <== osd.7 v2:172.21.15.132:6816/2222857157 2 ==== osd_op_reply(2 10000000011.00000000 [create] v23'13 uv13 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3adf4290 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 wanted_max_size 0 -> 3 2024-04-25T10:35:24.294 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 get_caps 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 clear_suid_sgid 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330); UserPerm(uid: 0, gid: 0) defer 0 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 5 client.4776 get_cap_ref got first FILE_BUFFER ref on 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 5 client.4776 get_cap_ref got first FILE_CACHE ref on 0x10000000011.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 mark_caps_dirty 0x10000000011.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) - -> Fw 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 cap_delay_requeue on 0x10000000011.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 get_quota_root realm 0x1 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 get_quota_root 0x10000000011.head -> 0x1.head 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 7 client.4776 wrote to 3, extending file size 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 mark_caps_dirty 0x10000000011.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) Fw -> Fw 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 cap_delay_requeue on 0x10000000011.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 3 client.4776 write(10, "...", 3, 0) = 3 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 3 client.4776 close enter(10) 2024-04-25T10:35:24.295 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 8 client.4776 _release_fh 0x55fa3ad7efb0 mode 2 on 0x10000000011.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 _flush 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- osd_op(unknown.0.0:3 3.15 3:ab5910e2:::10000000011.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) -- 0x55fa3aebfb20 con 0x55fa3adf4290 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 check_caps on 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 delaying cap release 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 cap_delay_requeue on 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 _release_fh 0x55fa3ad7efb0 on inode 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) no async_err state 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 3 client.4776 close exit(10) 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 path_walk AlternateNameLink_43224 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 0 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) AlternateNameLink_43224 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 (path is AlternateNameLink_43224) 2024-04-25T10:35:24.296 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 may_lookup 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 _getattr mask As issued=1 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 3 client.4776 may_lookup 0x7f517000cd50 = 0 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 _lookup have 0x1.head["AlternateNameLink_43224"] from mds.0 ttl 2024-04-25T10:35:54.068552+0000 seq 2 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 _lookup 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) AlternateNameLink_43224 = 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 path_walk cur=0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 path_walk 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 may_hardlink 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 _getattr mask As issued=1 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 3 client.4776 may_hardlink 0x7f517000d330 = 0 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 may_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 _getattr mask As issued=1 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 3 client.4776 may_create 0x7f517000cd50 = 0 2024-04-25T10:35:24.297 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 8 client.4776 _link(0x10000000011 to 0x1 AlternateNameLink_432242 uid 0 gid 0) 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 break_deleg: breaking delegs on 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 delegations_broken: delegations empty on 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 get_or_create 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) name AlternateNameLink_432242 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 15 client.4776 link dir 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 'AlternateNameLink_432242' dn 0x1.head["AlternateNameLink_432242"] (new dn) 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 choose_target_mds inode dir hash is 2 on AlternateNameLink_432242 => 2568453826 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 choose_target_mds 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) is_hash=1 hash=2568453826 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 choose_target_mds from dirfragtree hash 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 mds is 0 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 send_request rebuilding request 4 for mds.0 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 encode_cap_releases enter (req: 0x55fa3aec7af0, mds: 0) 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50), req:0x55fa3aec7af0 mds:0, drop:Fs, unless:Fx, force:0) 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 send_request set sent_stamp to 2024-04-25T10:35:24.074036+0000 2024-04-25T10:35:24.298 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 10 client.4776 send_request client_request(unknown.0:4 link #0x1/AlternateNameLink_432242 (foo2) #0x10000000011 2024-04-25T10:35:24.074019+0000 caller_uid=0, caller_gid=0{}) to mds.0 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_request(unknown.0:4 link #0x1/AlternateNameLink_432242 (foo2) #0x10000000011 2024-04-25T10:35:24.074019+0000 caller_uid=0, caller_gid=0{}) -- 0x55fa3aec01b0 con 0x55fa3ad801c0 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.073+0000 7f518d909480 20 client.4776 awaiting reply|forward|kick on 0x7ffc16ba7b40 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 6 ==== client_caps(revoke ino 0x10000000011 1 seq 2 caps=pAsxXsxFsxcrwb dirty=- wanted=pAsxXsxFxwb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.068519+0000 ctime 2024-04-25T10:35:24.068519+0000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f5180077440 con 0x55fa3ad801c0 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 5 client.4776 set_cap_epoch_barrier epoch = 23 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 mds.0 seq now 1 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 5 client.4776 handle_cap_grant on in 0x10000000011 mds.0 seq 2 caps now pAsxXsxFsxcrwb was pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) pAsxLsXsxFsxcrwb ctime 2024-04-25T10:35:24.068519+0000 mtime 2024-04-25T10:35:24.068519+0000 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 revocation of Ls 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 check_caps on 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) wanted Fxcb used Fcb issued pAsxXsxFsxcrwb revoking Ls flags=1 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 cap mds.0 issued pAsxXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking Ls 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 completed revocation of Ls 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 mark_caps_flushing Fw 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 mark_caps_clean 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.299 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 send_cap 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsxLxXsxFsxcrwbl held pAsxLsXsxFsxcrwb revoking Ls dropping - 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 15 client.4776 auth cap, requesting max_size 3 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000011 1 seq 2 tid 2 caps=pAsxXsxFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.073879+0000 ctime 2024-04-25T10:35:24.073879+0000 change_attr 1) -- 0x7f517000d910 con 0x55fa3ad801c0 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.074+0000 7f5184bce640 10 client.4776 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 7 ==== client_reply(???:4 = 0 (0) Success unsafe) ==== 827+0+0 (crc 0 0 0) 0x7f51800620d0 con 0x55fa3ad801c0 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 handle_client_reply got a reply. Safe:0 tid 4 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 insert_trace from 2024-04-25T10:35:24.074036+0000 mds.0 is_target=1 is_dentry=1 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 features 0xffffffffffffffff 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 update_snap_trace len 70 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref was 2 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 get_snap_realm 0x1 0x7f517000cc60, nref now is 3 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 hrm is_target=1 is_dentry=1 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 12 client.4776 add_update_inode had 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) caps pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.073879+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) pAsxXsxFsxcrwb ctime 2024-04-25T10:35:24.074019+0000 mtime 2024-04-25T10:35:24.073879+0000 2024-04-25T10:35:24.300 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 12 client.4776 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 2 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 add_update_cap issued pAsxXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"] 0x7f517000d330) 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 add_update_cap calling signal_caps_inode 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 12 client.4776 add_update_inode had 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) caps pAsLsXs 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 update_inode_file_time 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.068519+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) pAsLsXs ctime 2024-04-25T10:35:24.074019+0000 mtime 2024-04-25T10:35:24.068519+0000 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 dir hash is 2 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 12 client.4776 add_update_inode client inode change_attr: 35 , mds inodestat change_attr: 36 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 got dirfrag map for 0x1 frag * to mds 0 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 12 client.4776 insert_dentry_inode 'AlternateNameLink_432242' vino 0x10000000011.head in dir 0x1.head dn 0x55fa3ac7b2b0 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 15 client.4776 link dir 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 'AlternateNameLink_432242' to inode 0x7f517000d330 dn 0x1.head["AlternateNameLink_432242"] (old dn) 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"], 0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 link inode 0x7f517000d330 parents now 0x1.head["AlternateNameLink_43224"], 0x1.head["AlternateNameLink_432242"] 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"], 0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.301 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 15 client.4776 update_dentry_lease 0x1.head["AlternateNameLink_432242"] lease(mask 3 dur 30000 altn foo2)) from 2024-04-25T10:35:24.074036+0000 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 got dentry lease on AlternateNameLink_432242 dur 30000ms ttl 2024-04-25T10:35:54.074036+0000 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 put_snap_realm 0x1 0x7f517000cc60 3 -> 2 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 handle_client_reply signalling caller 0x7ffc16ba7b40 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 handle_client_reply awaiting kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 sendrecv kickback on tid 4 0x7f5184bcbdf0 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 lat 0.001641 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 link result is 0 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 trim_cache size 2 max 16384 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 8 client.4776 link(#0x10000000011, #0x1/AlternateNameLink_432242) = 0 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"], 0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 walk: AlternateNameLink_432242 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 path_walk cur=0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 path_walk AlternateNameLink_432242 2024-04-25T10:35:24.302 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 0 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) AlternateNameLink_432242 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 (path is AlternateNameLink_432242) 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 may_lookup 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 _getattr mask As issued=1 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 3 client.4776 may_lookup 0x7f517000cd50 = 0 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 _lookup have 0x1.head["AlternateNameLink_432242"] from mds.0 ttl 2024-04-25T10:35:54.074036+0000 seq 3 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 _lookup 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) AlternateNameLink_432242 = 0x10000000011.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"], 0x1.head["AlternateNameLink_432242"] 0x7f517000d330) 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 walk: AlternateNameLink_43224 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 path_walk cur=0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 path_walk AlternateNameLink_43224 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 0 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) AlternateNameLink_43224 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 (path is AlternateNameLink_43224) 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 may_lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50); UserPerm(uid: 0, gid: 0) 2024-04-25T10:35:24.303 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 _getattr mask As issued=1 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 3 client.4776 may_lookup 0x7f517000cd50 = 0 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 _lookup have 0x1.head["AlternateNameLink_43224"] from mds.0 ttl 2024-04-25T10:35:54.068552+0000 seq 2 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 _lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) AlternateNameLink_43224 = 0x10000000011.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"], 0x1.head["AlternateNameLink_432242"] 0x7f517000d330) 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"], 0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_43224"], 0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 2 client.4776 unmount 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 2 client.4776 unmounting 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_flushmdlog) -- 0x55fa3aec01b0 con 0x55fa3ad801c0 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size was 2+2 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 trim_cache size 2 max 16384 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 15 client.4776 trim_dentry unlinking dn AlternateNameLink_43224 in dir 0x1 2024-04-25T10:35:24.304 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 15 client.4776 unlink dir 0x7f517000cd50 'AlternateNameLink_43224' dn 0x7f515c00bab0 inode 0x7f517000d330 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 unlink inode 0x7f517000d330 parents now 0x1.head["AlternateNameLink_432242"] 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 15 client.4776 unlink removing 'AlternateNameLink_43224' dn 0x7f515c00bab0 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 unmounting: trim pass, cache shrank, poking unmount() 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f518d909480 10 client.4776 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 8 ==== client_caps(revoke ino 0x10000000011 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 3/4194304 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.073879+0000 ctime 2024-04-25T10:35:24.074019+0000 change_attr 2) ==== 260+0+0 (crc 0 0 0) 0x7f517000d910 con 0x55fa3ad801c0 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 mds.0 seq now 2 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 5 client.4776 handle_cap_grant on in 0x10000000011 mds.0 seq 4 caps now pAsLsXsFsxcrwb was pAsxLsXsxFsxcrwb 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) pAsxLsXsxFsxcrwb ctime 2024-04-25T10:35:24.074019+0000 mtime 2024-04-25T10:35:24.073879+0000 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 revocation of AxXx 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 check_caps on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) wanted Fxcb used Fcb issued pAsLsXsFsxcrwb revoking AxXx flags=1 2024-04-25T10:35:24.305 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 cap mds.0 issued pAsLsXsFsxcrwb implemented pAsxLsXsxFsxcrwb revoking AxXx 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 completed revocation of AxXx 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 send_cap 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) mds.0 seq 4 used Fcb want Fxcb flush - retain pFxcb held pAsxLsXsxFsxcrwb revoking AxXx dropping AsLsXsFsrw 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 15 client.4776 auth cap, requesting max_size 3 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_caps(update ino 0x10000000011 1 seq 4 caps=pFxcb dirty=- wanted=Fxcb follows 0 size 3/3 ts 1/18446744073709551615 mtime 2024-04-25T10:35:24.073879+0000 ctime 2024-04-25T10:35:24.074019+0000 change_attr 2) -- 0x7f5180077440 con 0x55fa3ad801c0 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 handle_cap_grant calling signal_caps_inode 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size was 1+2 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 20 client.4776 trim_cache size 1 max 16384 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.075+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size still 1+2 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5186bd2640 1 -- 172.21.15.103:0/2347418370 <== osd.7 v2:172.21.15.132:6816/2222857157 3 ==== osd_op_reply(3 10000000011.00000000 [write 0~3] v23'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f517c046070 con 0x55fa3adf4290 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f51777fe640 10 client.4776 _flushed 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f51777fe640 5 client.4776 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f51777fe640 5 client.4776 put_cap_ref dropped last FILE_CACHE ref on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f51777fe640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 2 2024-04-25T10:35:24.306 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f51777fe640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 9 ==== client_caps(flush_ack ino 0x10000000011 1 seq 2 tid 2 caps=pAsxXsxFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) ==== 260+0+0 (crc 0 0 0) 0x7f5180077440 con 0x55fa3ad801c0 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 mds.0 seq now 3 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 5 client.4776 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) with Fw 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 5 client.4776 flushing_caps Fw -> - 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) !flushing 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 handle_cap_flush_ack calling signal_caps_inode 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size was 1+2 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 trim_cache size 1 max 16384 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size still 1+2 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 10 ==== client_snap(split split=0x10000000011 tracelen=140) ==== 172+0+0 (crc 0 0 0) 0x7f5180062c60 con 0x55fa3ad801c0 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 handle_snap client_snap(split split=0x10000000011 tracelen=140) 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 mds.0 seq now 4 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 get_snap_realm 0x10000000011 0, nref was 0 2024-04-25T10:35:24.307 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 get_snap_realm 0x10000000011 0x7f515c00bab0, nref now is 1 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 splitting off snaprealm(0x10000000011 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 moving 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) from snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-04-25T10:33:43.165511+0000 change_attr=0) 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 put_snap_realm 0x1 0x7f517000cc60 2 -> 1 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 update_snap_trace len 140 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 get_snap_realm 0x10000000011 0x7f515c00bab0, nref was 1 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 get_snap_realm 0x10000000011 0x7f515c00bab0, nref now is 2 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 update_snap_trace snaprealm(0x10000000011 nref=2 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 adjust_realm_parent snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) 0x0 -> 0x3 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 get_snap_realm 0x3 0, nref was 0 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 get_snap_realm 0x3 0x7f517000dc70, nref now is 2 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 invalidate_snaprealm_and_children snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x3 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 15 client.4776 update_snap_trace snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x3 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) self|parent updated 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 15 client.4776 snapc 1=[] 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 get_snap_realm 0x3 0x7f517000dc70, nref was 2 2024-04-25T10:35:24.308 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 get_snap_realm 0x3 0x7f517000dc70, nref now is 3 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 update_snap_trace snaprealm(0x3 nref=3 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 invalidate_snaprealm_and_children snaprealm(0x3 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 invalidate_snaprealm_and_children snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x3 my_snaps=[] cached_snapc=1=[] last_modified=0.000000 change_attr=0) 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 15 client.4776 update_snap_trace snaprealm(0x3 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) self|parent updated 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 15 client.4776 snapc 1=[] 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 put_snap_realm 0x3 0x7f517000dc70 4 -> 3 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 no new snap on snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x3 my_snaps=[] cached_snapc=1=[] last_modified=0.000000 change_attr=0) 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 put_snap_realm 0x10000000011 0x7f515c00bab0 3 -> 2 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 no new snap on snaprealm(0x3 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=0.000000 change_attr=0) 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 put_snap_realm 0x3 0x7f517000dc70 3 -> 2 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 put_snap_realm 0x10000000011 0x7f515c00bab0 2 -> 1 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 put_snap_realm 0x10000000011 0x7f515c00bab0 2 -> 1 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size was 1+2 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 20 client.4776 trim_cache size 1 max 16384 2024-04-25T10:35:24.309 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.078+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size still 1+2 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 11 ==== client_reply(???:4 = 0 (0) Success safe) ==== 27+0+0 (crc 0 0 0) 0x7f5180000bc0 con 0x55fa3ad801c0 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 20 client.4776 handle_client_reply got a reply. Safe:1 tid 4 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 10 client.4776 insert_trace from 2024-04-25T10:35:24.074036+0000 mds.0 is_target=0 is_dentry=0 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 10 client.4776 insert_trace -- already got unsafe; ignoring 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _ll_drop_pins 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 _ll_put 0x7f517000cd50 0x1 1 -> 0 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 _release 0x10000000011.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) 2024-04-25T10:35:24.310 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _invalidate_inode_cache 0x10000000011.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _flush 0x10000000011.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 nothing to flush 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 _release 0x1.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _flush 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 nothing to flush 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_432242"] 0x7f517000d330) n = 1 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 flush_caps_sync 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 trim_cache size 1 max 16384 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 15 client.4776 trim_dentry unlinking dn AlternateNameLink_432242 in dir 0x1 2024-04-25T10:35:24.311 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 15 client.4776 unlink dir 0x7f517000cd50 'AlternateNameLink_432242' dn 0x55fa3ac7b2b0 inode 0x7f517000d330 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d330) n = 1 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 unlink inode 0x7f517000d330 parents now 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 15 client.4776 unlink removing 'AlternateNameLink_432242' dn 0x55fa3ac7b2b0 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 15 client.4776 close_dir dir 0x55fa3aec8da0 on 0x7f517000cd50 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 1 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_inode on 0x10000000011.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d330) n = 1 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) n = 23 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 15 client.4776 remove_cap last one, closing snaprealm 0x7f517000cc60 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_snap_realm 0x1 0x7f517000cc60 1 -> 0 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-04-25T10:33:43.165511+0000 mtime=2024-04-25T10:35:24.068519+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=36 caps=- has_dir_layout 0x7f517000cd50) 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _put_inode on 0x10000000011.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d330) n = 22 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 remove_cap mds.0 on 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=pFxcb(0=pFxcb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d330) 2024-04-25T10:35:24.312 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 15 client.4776 remove_cap last one, closing snaprealm 0x7f515c00bab0 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_snap_realm 0x10000000011 0x7f515c00bab0 1 -> 0 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 20 client.4776 put_snap_realm 0x3 0x7f517000dc70 2 -> 1 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 10 client.4776 _put_inode deleting 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-04-25T10:35:24.068519+0000 mtime=2024-04-25T10:35:24.073879+0000 ctime=2024-04-25T10:35:24.074019+0000 change_attr=2 caps=- objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f517000d330) 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 2 client.4776 _close_mds_session mds.0 seq 4 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 --> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] -- client_session(request_close seq 4) -- 0x55fa3adfe0f0 con 0x55fa3ad801c0 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f518d909480 2 client.4776 waiting for 1 mds session(s) to close (timeout: 30s) 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size was 0+0 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 20 client.4776 trim_cache size 0 max 16384 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.079+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size still 0+0 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 <== mds.0 v2:172.21.15.103:6834/2389441335 12 ==== client_session(close) ==== 28+0+0 (crc 0 0 0) 0x55fa3aec01b0 con 0x55fa3ad801c0 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 10 client.4776 handle_client_session client_session(close) from mds.0 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 5 client.4776 _closed_mds_session mds.0 seq 4 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 1 -- 172.21.15.103:0/2347418370 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad801c0 msgr2=0x55fa3ad7add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.103:6834/2389441335,v1:172.21.15.103:6835/2389441335] conn(0x55fa3ad801c0 0x55fa3ad7add0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.313 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 10 client.4776 remove_session_caps mds.0 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 10 client.4776 kick_requests_closed for mds.0 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size was 0+0 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 20 client.4776 trim_cache size 0 max 16384 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f5184bce640 10 client.4776 unmounting: trim pass, size still 0+0 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f518d909480 20 client.4776 put_snap_realm 0x3 0x7f517000dc70 1 -> 0 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f518d909480 2 client.4776 unmounted. 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.080+0000 7f518d909480 1 client.4776 shutdown 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3adf4290 msgr2=0x55fa3ad78090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x55fa3adf4290 0x55fa3ad78090 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 msgr2=0x55fa3aeb8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 1 --2- 172.21.15.103:0/2347418370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fa3aeb1180 0x55fa3aeb8fa0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5178002010 tx=0x7f5178055000 comp rx=0 tx=0).stop 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f5187bd4640 1 -- 172.21.15.103:0/2347418370 reap_dead start 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 shutdown_connections 2024-04-25T10:35:24.314 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 >> 172.21.15.103:0/2347418370 conn(0x55fa3ac71ab0 msgr2=0x55fa3ad7c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:24.315 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 shutdown_connections 2024-04-25T10:35:24.315 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 1 -- 172.21.15.103:0/2347418370 wait complete. 2024-04-25T10:35:24.315 INFO:tasks.workunit.client.0.smithi103.stderr:2024-04-25T10:35:24.081+0000 7f518d909480 20 client.4776 trim_cache size 0 max 16384 2024-04-25T10:35:24.316 INFO:tasks.workunit.client.0.smithi103.stdout:[ OK ] TestClient.AlternateNameLink (41 ms) 2024-04-25T10:35:24.316 INFO:tasks.workunit.client.0.smithi103.stdout:[----------] 25 tests from TestClient (5530 ms total) 2024-04-25T10:35:24.316 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-04-25T10:35:24.316 INFO:tasks.workunit.client.0.smithi103.stdout:[----------] Global test environment tear-down 2024-04-25T10:35:24.316 INFO:tasks.workunit.client.0.smithi103.stdout:[==========] 25 tests from 1 test suite ran. (5531 ms total) 2024-04-25T10:35:24.316 INFO:tasks.workunit.client.0.smithi103.stdout:[ PASSED ] 25 tests. 2024-04-25T10:35:24.316 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T10:35:24.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T10:35:24.340 INFO:tasks.workunit:Stopping ['client/test.sh'] on client.0... 2024-04-25T10:35:24.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T10:35:24.620 DEBUG:teuthology.parallel:result is None 2024-04-25T10:35:24.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T10:35:24.652 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T10:35:24.652 DEBUG:teuthology.orchestra.run.smithi103:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-25T10:35:24.747 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T10:35:24.748 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T10:35:24.758 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T10:35:24.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:35:24.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.864+0000 7fa26159d640 1 Processor -- start 2024-04-25T10:35:24.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.864+0000 7fa26159d640 1 -- start start 2024-04-25T10:35:24.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa26159d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa25c072d50 0x7fa25c070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa26159d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa25c14d920 con 0x7fa25c149a10 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa26159d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa25c073330 con 0x7fa25c0b7f50 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa26159d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa25c14caa0 con 0x7fa25c072d50 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa25a7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa25c072d50 0x7fa25c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa25b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa25c149a10 0x7fa25c149e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48254/0 (socket says 172.21.15.103:48254) 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa25b7fe640 1 -- 172.21.15.103:0/4108243549 learned_addr learned my addr 172.21.15.103:0/4108243549 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa25a7fc640 1 -- 172.21.15.103:0/4108243549 >> v1:172.21.15.132:6789/0 conn(0x7fa25c0b7f50 legacy=0x7fa25c14d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa25a7fc640 1 -- 172.21.15.103:0/4108243549 >> v1:172.21.15.103:6789/0 conn(0x7fa25c149a10 legacy=0x7fa25c149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa259ffb640 1 -- 172.21.15.103:0/4108243549 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200932990 0 0) 0x7fa25c14d920 con 0x7fa25c149a10 2024-04-25T10:35:24.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.865+0000 7fa25a7fc640 1 -- 172.21.15.103:0/4108243549 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c14ccf0 con 0x7fa25c072d50 2024-04-25T10:35:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.866+0000 7fa25a7fc640 1 --2- 172.21.15.103:0/4108243549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c072d50 0x7fa25c070330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2500097a0 tx=0x7fa25002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c25ca32b968609 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.866+0000 7fa259ffb640 1 -- 172.21.15.103:0/4108243549 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250037070 con 0x7fa25c072d50 2024-04-25T10:35:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.866+0000 7fa259ffb640 1 -- 172.21.15.103:0/4108243549 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa250032440 con 0x7fa25c072d50 2024-04-25T10:35:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.866+0000 7fa259ffb640 1 -- 172.21.15.103:0/4108243549 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250032810 con 0x7fa25c072d50 2024-04-25T10:35:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.867+0000 7fa26159d640 1 -- 172.21.15.103:0/4108243549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c072d50 msgr2=0x7fa25c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.867+0000 7fa26159d640 1 --2- 172.21.15.103:0/4108243549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c072d50 0x7fa25c070330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa2500097a0 tx=0x7fa25002a1e0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.867+0000 7fa26159d640 1 -- 172.21.15.103:0/4108243549 shutdown_connections 2024-04-25T10:35:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.867+0000 7fa26159d640 1 --2- 172.21.15.103:0/4108243549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c072d50 0x7fa25c070330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.867+0000 7fa26159d640 1 -- 172.21.15.103:0/4108243549 >> 172.21.15.103:0/4108243549 conn(0x7fa25c06f630 msgr2=0x7fa25c06fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.867+0000 7fa26159d640 1 -- 172.21.15.103:0/4108243549 shutdown_connections 2024-04-25T10:35:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.867+0000 7fa26159d640 1 -- 172.21.15.103:0/4108243549 wait complete. 2024-04-25T10:35:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.868+0000 7fa26159d640 1 Processor -- start 2024-04-25T10:35:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.868+0000 7fa26159d640 1 -- start start 2024-04-25T10:35:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa26159d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa25c072d50 0x7fa25c0ba910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa26159d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c0b7f50 0x7fa25c1e25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa26159d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa25c149a10 0x7fa25c1e2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa26159d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c13f680 con 0x7fa25c0b7f50 2024-04-25T10:35:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa26159d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c073fe0 con 0x7fa25c149a10 2024-04-25T10:35:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa26159d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa25c13f800 con 0x7fa25c072d50 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa25a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c0b7f50 0x7fa25c1e25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa25a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c0b7f50 0x7fa25c1e25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50656/0 (socket says 172.21.15.103:50656) 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.869+0000 7fa25a7fc640 1 -- 172.21.15.103:0/447910373 learned_addr learned my addr 172.21.15.103:0/447910373 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25affd640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa25c072d50 0x7fa25c0ba910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25a7fc640 1 -- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa25c072d50 msgr2=0x7fa25c0ba910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25b7fe640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa25c149a10 0x7fa25c1e2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25a7fc640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa25c072d50 0x7fa25c0ba910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25a7fc640 1 -- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa25c149a10 msgr2=0x7fa25c1e2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25a7fc640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa25c149a10 0x7fa25c1e2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25a7fc640 1 -- 172.21.15.103:0/447910373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c1421b0 con 0x7fa25c0b7f50 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25affd640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa25c072d50 0x7fa25c0ba910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa25a7fc640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c0b7f50 0x7fa25c1e25d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa2500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa2437fe640 1 -- 172.21.15.103:0/447910373 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250041070 con 0x7fa25c0b7f50 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa2437fe640 1 -- 172.21.15.103:0/447910373 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25003c930 con 0x7fa25c0b7f50 2024-04-25T10:35:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa2437fe640 1 -- 172.21.15.103:0/447910373 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250037040 con 0x7fa25c0b7f50 2024-04-25T10:35:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c1414d0 con 0x7fa25c0b7f50 2024-04-25T10:35:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.870+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c1df470 con 0x7fa25c0b7f50 2024-04-25T10:35:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.871+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25c0a0070 con 0x7fa25c0b7f50 2024-04-25T10:35:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.872+0000 7fa2437fe640 1 -- 172.21.15.103:0/447910373 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa250044070 con 0x7fa25c0b7f50 2024-04-25T10:35:24.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.872+0000 7fa2437fe640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa2480744e0 0x7fa2480769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:24.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.872+0000 7fa25affd640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa2480744e0 0x7fa2480769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:24.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.872+0000 7fa2437fe640 1 -- 172.21.15.103:0/447910373 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fa2500b5e60 con 0x7fa25c0b7f50 2024-04-25T10:35:24.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.873+0000 7fa25affd640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa2480744e0 0x7fa2480769f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa24c007fd0 tx=0x7fa24c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:24.877+0000 7fa2437fe640 1 -- 172.21.15.103:0/447910373 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2500805e0 con 0x7fa25c0b7f50 2024-04-25T10:35:25.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.052+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa25c143d70 con 0x7fa2480744e0 2024-04-25T10:35:25.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.059+0000 7fa2437fe640 1 -- 172.21.15.103:0/447910373 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251861 (secure 0 0 0) 0x7fa25c143d70 con 0x7fa2480744e0 2024-04-25T10:35:25.063 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:35:25.065 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:35:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa2480744e0 msgr2=0x7fa2480769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa2480744e0 0x7fa2480769f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa24c007fd0 tx=0x7fa24c009040 comp rx=0 tx=0).stop 2024-04-25T10:35:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c0b7f50 msgr2=0x7fa25c1e25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c0b7f50 0x7fa25c1e25d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa2500046c0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 shutdown_connections 2024-04-25T10:35:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa2480744e0 0x7fa2480769f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa25c149a10 0x7fa25c1e2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25c0b7f50 0x7fa25c1e25d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 --2- 172.21.15.103:0/447910373 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa25c072d50 0x7fa25c0ba910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 >> 172.21.15.103:0/447910373 conn(0x7fa25c06f630 msgr2=0x7fa25c075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 shutdown_connections 2024-04-25T10:35:25.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.062+0000 7fa26159d640 1 -- 172.21.15.103:0/447910373 wait complete. 2024-04-25T10:35:25.075 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-25T10:35:24.515380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659249,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":218,"num_write_kb":1748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219396,"kb_used_data":3236,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755324,"statfs":{"total":773094113280,"available":772869451776,"internally_reserved":0,"allocated":3313664,"data_stored":2026203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":66471,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":72,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002178"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620741+0000","last_change":"2024-04-25T10:33:43.181183+0000","last_active":"2024-04-25T10:35:19.620741+0000","last_peered":"2024-04-25T10:35:19.620741+0000","last_clean":"2024-04-25T10:35:19.620741+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:35:19.620741+0000","last_undegraded":"2024-04-25T10:35:19.620741+0000","last_fullsized":"2024-04-25T10:35:19.620741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:44.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590380+0000","last_change":"2024-04-25T10:33:43.170436+0000","last_active":"2024-04-25T10:35:19.590380+0000","last_peered":"2024-04-25T10:35:19.590380+0000","last_clean":"2024-04-25T10:35:19.590380+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:35:19.590380+0000","last_undegraded":"2024-04-25T10:35:19.590380+0000","last_fullsized":"2024-04-25T10:35:19.590380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619458+0000","last_change":"2024-04-25T10:33:43.181271+0000","last_active":"2024-04-25T10:35:19.619458+0000","last_peered":"2024-04-25T10:35:19.619458+0000","last_clean":"2024-04-25T10:35:19.619458+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:35:19.619458+0000","last_undegraded":"2024-04-25T10:35:19.619458+0000","last_fullsized":"2024-04-25T10:35:19.619458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591102+0000","last_change":"2024-04-25T10:33:43.176831+0000","last_active":"2024-04-25T10:35:19.591102+0000","last_peered":"2024-04-25T10:35:19.591102+0000","last_clean":"2024-04-25T10:35:19.591102+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:35:19.591102+0000","last_undegraded":"2024-04-25T10:35:19.591102+0000","last_fullsized":"2024-04-25T10:35:19.591102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620456+0000","last_change":"2024-04-25T10:33:43.181222+0000","last_active":"2024-04-25T10:35:19.620456+0000","last_peered":"2024-04-25T10:35:19.620456+0000","last_clean":"2024-04-25T10:35:19.620456+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:35:19.620456+0000","last_undegraded":"2024-04-25T10:35:19.620456+0000","last_fullsized":"2024-04-25T10:35:19.620456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:42.544249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590996+0000","last_change":"2024-04-25T10:33:43.175444+0000","last_active":"2024-04-25T10:35:19.590996+0000","last_peered":"2024-04-25T10:35:19.590996+0000","last_clean":"2024-04-25T10:35:19.590996+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:35:19.590996+0000","last_undegraded":"2024-04-25T10:35:19.590996+0000","last_fullsized":"2024-04-25T10:35:19.590996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620299+0000","last_change":"2024-04-25T10:33:43.186303+0000","last_active":"2024-04-25T10:35:19.620299+0000","last_peered":"2024-04-25T10:35:19.620299+0000","last_clean":"2024-04-25T10:35:19.620299+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:35:19.620299+0000","last_undegraded":"2024-04-25T10:35:19.620299+0000","last_fullsized":"2024-04-25T10:35:19.620299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599277+0000","last_change":"2024-04-25T10:33:43.169919+0000","last_active":"2024-04-25T10:35:19.599277+0000","last_peered":"2024-04-25T10:35:19.599277+0000","last_clean":"2024-04-25T10:35:19.599277+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:35:19.599277+0000","last_undegraded":"2024-04-25T10:35:19.599277+0000","last_fullsized":"2024-04-25T10:35:19.599277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620817+0000","last_change":"2024-04-25T10:34:24.321277+0000","last_active":"2024-04-25T10:35:19.620817+0000","last_peered":"2024-04-25T10:35:19.620817+0000","last_clean":"2024-04-25T10:35:19.620817+0000","last_became_active":"2024-04-25T10:34:24.320939+0000","last_became_peered":"2024-04-25T10:34:24.320939+0000","last_unstale":"2024-04-25T10:35:19.620817+0000","last_undegraded":"2024-04-25T10:35:19.620817+0000","last_fullsized":"2024-04-25T10:35:19.620817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:35.139675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594280+0000","last_change":"2024-04-25T10:33:43.175552+0000","last_active":"2024-04-25T10:35:19.594280+0000","last_peered":"2024-04-25T10:35:19.594280+0000","last_clean":"2024-04-25T10:35:19.594280+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:35:19.594280+0000","last_undegraded":"2024-04-25T10:35:19.594280+0000","last_fullsized":"2024-04-25T10:35:19.594280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594215+0000","last_change":"2024-04-25T10:33:43.175526+0000","last_active":"2024-04-25T10:35:19.594215+0000","last_peered":"2024-04-25T10:35:19.594215+0000","last_clean":"2024-04-25T10:35:19.594215+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:35:19.594215+0000","last_undegraded":"2024-04-25T10:35:19.594215+0000","last_fullsized":"2024-04-25T10:35:19.594215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592368+0000","last_change":"2024-04-25T10:33:43.176506+0000","last_active":"2024-04-25T10:35:19.592368+0000","last_peered":"2024-04-25T10:35:19.592368+0000","last_clean":"2024-04-25T10:35:19.592368+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:35:19.592368+0000","last_undegraded":"2024-04-25T10:35:19.592368+0000","last_fullsized":"2024-04-25T10:35:19.592368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:54.213946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599412+0000","last_change":"2024-04-25T10:33:43.178091+0000","last_active":"2024-04-25T10:35:19.599412+0000","last_peered":"2024-04-25T10:35:19.599412+0000","last_clean":"2024-04-25T10:35:19.599412+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:35:19.599412+0000","last_undegraded":"2024-04-25T10:35:19.599412+0000","last_fullsized":"2024-04-25T10:35:19.599412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'2","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619231+0000","last_change":"2024-04-25T10:33:43.173440+0000","last_active":"2024-04-25T10:35:19.619231+0000","last_peered":"2024-04-25T10:35:19.619231+0000","last_clean":"2024-04-25T10:35:19.619231+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:35:19.619231+0000","last_undegraded":"2024-04-25T10:35:19.619231+0000","last_fullsized":"2024-04-25T10:35:19.619231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.607252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590008+0000","last_change":"2024-04-25T10:33:43.172566+0000","last_active":"2024-04-25T10:35:19.590008+0000","last_peered":"2024-04-25T10:35:19.590008+0000","last_clean":"2024-04-25T10:35:19.590008+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:35:19.590008+0000","last_undegraded":"2024-04-25T10:35:19.590008+0000","last_fullsized":"2024-04-25T10:35:19.590008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590878+0000","last_change":"2024-04-25T10:33:43.175162+0000","last_active":"2024-04-25T10:35:19.590878+0000","last_peered":"2024-04-25T10:35:19.590878+0000","last_clean":"2024-04-25T10:35:19.590878+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:35:19.590878+0000","last_undegraded":"2024-04-25T10:35:19.590878+0000","last_fullsized":"2024-04-25T10:35:19.590878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591309+0000","last_change":"2024-04-25T10:33:43.183071+0000","last_active":"2024-04-25T10:35:19.591309+0000","last_peered":"2024-04-25T10:35:19.591309+0000","last_clean":"2024-04-25T10:35:19.591309+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:35:19.591309+0000","last_undegraded":"2024-04-25T10:35:19.591309+0000","last_fullsized":"2024-04-25T10:35:19.591309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620468+0000","last_change":"2024-04-25T10:33:43.179022+0000","last_active":"2024-04-25T10:35:19.620468+0000","last_peered":"2024-04-25T10:35:19.620468+0000","last_clean":"2024-04-25T10:35:19.620468+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:35:19.620468+0000","last_undegraded":"2024-04-25T10:35:19.620468+0000","last_fullsized":"2024-04-25T10:35:19.620468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620727+0000","last_change":"2024-04-25T10:33:43.186661+0000","last_active":"2024-04-25T10:35:19.620727+0000","last_peered":"2024-04-25T10:35:19.620727+0000","last_clean":"2024-04-25T10:35:19.620727+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:35:19.620727+0000","last_undegraded":"2024-04-25T10:35:19.620727+0000","last_fullsized":"2024-04-25T10:35:19.620727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.758005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594145+0000","last_change":"2024-04-25T10:33:43.175801+0000","last_active":"2024-04-25T10:35:19.594145+0000","last_peered":"2024-04-25T10:35:19.594145+0000","last_clean":"2024-04-25T10:35:19.594145+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:35:19.594145+0000","last_undegraded":"2024-04-25T10:35:19.594145+0000","last_fullsized":"2024-04-25T10:35:19.594145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619437+0000","last_change":"2024-04-25T10:33:43.183056+0000","last_active":"2024-04-25T10:35:19.619437+0000","last_peered":"2024-04-25T10:35:19.619437+0000","last_clean":"2024-04-25T10:35:19.619437+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:35:19.619437+0000","last_undegraded":"2024-04-25T10:35:19.619437+0000","last_fullsized":"2024-04-25T10:35:19.619437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591030+0000","last_change":"2024-04-25T10:33:43.180388+0000","last_active":"2024-04-25T10:35:19.591030+0000","last_peered":"2024-04-25T10:35:19.591030+0000","last_clean":"2024-04-25T10:35:19.591030+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:35:19.591030+0000","last_undegraded":"2024-04-25T10:35:19.591030+0000","last_fullsized":"2024-04-25T10:35:19.591030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599358+0000","last_change":"2024-04-25T10:33:43.162216+0000","last_active":"2024-04-25T10:35:19.599358+0000","last_peered":"2024-04-25T10:35:19.599358+0000","last_clean":"2024-04-25T10:35:19.599358+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:35:19.599358+0000","last_undegraded":"2024-04-25T10:35:19.599358+0000","last_fullsized":"2024-04-25T10:35:19.599358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590950+0000","last_change":"2024-04-25T10:33:43.183734+0000","last_active":"2024-04-25T10:35:19.590950+0000","last_peered":"2024-04-25T10:35:19.590950+0000","last_clean":"2024-04-25T10:35:19.590950+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:35:19.590950+0000","last_undegraded":"2024-04-25T10:35:19.590950+0000","last_fullsized":"2024-04-25T10:35:19.590950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620538+0000","last_change":"2024-04-25T10:34:24.299795+0000","last_active":"2024-04-25T10:35:19.620538+0000","last_peered":"2024-04-25T10:35:19.620538+0000","last_clean":"2024-04-25T10:35:19.620538+0000","last_became_active":"2024-04-25T10:34:24.299359+0000","last_became_peered":"2024-04-25T10:34:24.299359+0000","last_unstale":"2024-04-25T10:35:19.620538+0000","last_undegraded":"2024-04-25T10:35:19.620538+0000","last_fullsized":"2024-04-25T10:35:19.620538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594381+0000","last_change":"2024-04-25T10:33:43.183648+0000","last_active":"2024-04-25T10:35:19.594381+0000","last_peered":"2024-04-25T10:35:19.594381+0000","last_clean":"2024-04-25T10:35:19.594381+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:35:19.594381+0000","last_undegraded":"2024-04-25T10:35:19.594381+0000","last_fullsized":"2024-04-25T10:35:19.594381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'2","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590117+0000","last_change":"2024-04-25T10:33:43.175229+0000","last_active":"2024-04-25T10:35:19.590117+0000","last_peered":"2024-04-25T10:35:19.590117+0000","last_clean":"2024-04-25T10:35:19.590117+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:35:19.590117+0000","last_undegraded":"2024-04-25T10:35:19.590117+0000","last_fullsized":"2024-04-25T10:35:19.590117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599703+0000","last_change":"2024-04-25T10:33:43.162579+0000","last_active":"2024-04-25T10:35:19.599703+0000","last_peered":"2024-04-25T10:35:19.599703+0000","last_clean":"2024-04-25T10:35:19.599703+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:35:19.599703+0000","last_undegraded":"2024-04-25T10:35:19.599703+0000","last_fullsized":"2024-04-25T10:35:19.599703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619415+0000","last_change":"2024-04-25T10:33:43.168576+0000","last_active":"2024-04-25T10:35:19.619415+0000","last_peered":"2024-04-25T10:35:19.619415+0000","last_clean":"2024-04-25T10:35:19.619415+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:35:19.619415+0000","last_undegraded":"2024-04-25T10:35:19.619415+0000","last_fullsized":"2024-04-25T10:35:19.619415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591110+0000","last_change":"2024-04-25T10:33:43.182970+0000","last_active":"2024-04-25T10:35:19.591110+0000","last_peered":"2024-04-25T10:35:19.591110+0000","last_clean":"2024-04-25T10:35:19.591110+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:35:19.591110+0000","last_undegraded":"2024-04-25T10:35:19.591110+0000","last_fullsized":"2024-04-25T10:35:19.591110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620250+0000","last_change":"2024-04-25T10:33:43.171456+0000","last_active":"2024-04-25T10:35:19.620250+0000","last_peered":"2024-04-25T10:35:19.620250+0000","last_clean":"2024-04-25T10:35:19.620250+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:35:19.620250+0000","last_undegraded":"2024-04-25T10:35:19.620250+0000","last_fullsized":"2024-04-25T10:35:19.620250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593943+0000","last_change":"2024-04-25T10:33:43.183419+0000","last_active":"2024-04-25T10:35:19.593943+0000","last_peered":"2024-04-25T10:35:19.593943+0000","last_clean":"2024-04-25T10:35:19.593943+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:35:19.593943+0000","last_undegraded":"2024-04-25T10:35:19.593943+0000","last_fullsized":"2024-04-25T10:35:19.593943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592007+0000","last_change":"2024-04-25T10:33:43.170134+0000","last_active":"2024-04-25T10:35:19.592007+0000","last_peered":"2024-04-25T10:35:19.592007+0000","last_clean":"2024-04-25T10:35:19.592007+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:35:19.592007+0000","last_undegraded":"2024-04-25T10:35:19.592007+0000","last_fullsized":"2024-04-25T10:35:19.592007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:06.463548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599586+0000","last_change":"2024-04-25T10:33:42.162138+0000","last_active":"2024-04-25T10:35:19.599586+0000","last_peered":"2024-04-25T10:35:19.599586+0000","last_clean":"2024-04-25T10:35:19.599586+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:35:19.599586+0000","last_undegraded":"2024-04-25T10:35:19.599586+0000","last_fullsized":"2024-04-25T10:35:19.599586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619546+0000","last_change":"2024-04-25T10:33:43.172141+0000","last_active":"2024-04-25T10:35:19.619546+0000","last_peered":"2024-04-25T10:35:19.619546+0000","last_clean":"2024-04-25T10:35:19.619546+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:35:19.619546+0000","last_undegraded":"2024-04-25T10:35:19.619546+0000","last_fullsized":"2024-04-25T10:35:19.619546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594071+0000","last_change":"2024-04-25T10:33:42.161614+0000","last_active":"2024-04-25T10:35:19.594071+0000","last_peered":"2024-04-25T10:35:19.594071+0000","last_clean":"2024-04-25T10:35:19.594071+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:35:19.594071+0000","last_undegraded":"2024-04-25T10:35:19.594071+0000","last_fullsized":"2024-04-25T10:35:19.594071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599385+0000","last_change":"2024-04-25T10:33:42.158934+0000","last_active":"2024-04-25T10:35:19.599385+0000","last_peered":"2024-04-25T10:35:19.599385+0000","last_clean":"2024-04-25T10:35:19.599385+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:35:19.599385+0000","last_undegraded":"2024-04-25T10:35:19.599385+0000","last_fullsized":"2024-04-25T10:35:19.599385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599345+0000","last_change":"2024-04-25T10:33:43.170270+0000","last_active":"2024-04-25T10:35:19.599345+0000","last_peered":"2024-04-25T10:35:19.599345+0000","last_clean":"2024-04-25T10:35:19.599345+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:35:19.599345+0000","last_undegraded":"2024-04-25T10:35:19.599345+0000","last_fullsized":"2024-04-25T10:35:19.599345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591039+0000","last_change":"2024-04-25T10:33:42.162167+0000","last_active":"2024-04-25T10:35:19.591039+0000","last_peered":"2024-04-25T10:35:19.591039+0000","last_clean":"2024-04-25T10:35:19.591039+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:35:19.591039+0000","last_undegraded":"2024-04-25T10:35:19.591039+0000","last_fullsized":"2024-04-25T10:35:19.591039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590003+0000","last_change":"2024-04-25T10:33:43.174366+0000","last_active":"2024-04-25T10:35:19.590003+0000","last_peered":"2024-04-25T10:35:19.590003+0000","last_clean":"2024-04-25T10:35:19.590003+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:35:19.590003+0000","last_undegraded":"2024-04-25T10:35:19.590003+0000","last_fullsized":"2024-04-25T10:35:19.590003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594335+0000","last_change":"2024-04-25T10:33:42.163161+0000","last_active":"2024-04-25T10:35:19.594335+0000","last_peered":"2024-04-25T10:35:19.594335+0000","last_clean":"2024-04-25T10:35:19.594335+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:35:19.594335+0000","last_undegraded":"2024-04-25T10:35:19.594335+0000","last_fullsized":"2024-04-25T10:35:19.594335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591501+0000","last_change":"2024-04-25T10:33:43.179159+0000","last_active":"2024-04-25T10:35:19.591501+0000","last_peered":"2024-04-25T10:35:19.591501+0000","last_clean":"2024-04-25T10:35:19.591501+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:35:19.591501+0000","last_undegraded":"2024-04-25T10:35:19.591501+0000","last_fullsized":"2024-04-25T10:35:19.591501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591501+0000","last_change":"2024-04-25T10:33:42.168608+0000","last_active":"2024-04-25T10:35:19.591501+0000","last_peered":"2024-04-25T10:35:19.591501+0000","last_clean":"2024-04-25T10:35:19.591501+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:35:19.591501+0000","last_undegraded":"2024-04-25T10:35:19.591501+0000","last_fullsized":"2024-04-25T10:35:19.591501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619569+0000","last_change":"2024-04-25T10:33:43.172553+0000","last_active":"2024-04-25T10:35:19.619569+0000","last_peered":"2024-04-25T10:35:19.619569+0000","last_clean":"2024-04-25T10:35:19.619569+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:35:19.619569+0000","last_undegraded":"2024-04-25T10:35:19.619569+0000","last_fullsized":"2024-04-25T10:35:19.619569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590175+0000","last_change":"2024-04-25T10:33:42.160656+0000","last_active":"2024-04-25T10:35:19.590175+0000","last_peered":"2024-04-25T10:35:19.590175+0000","last_clean":"2024-04-25T10:35:19.590175+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:35:19.590175+0000","last_undegraded":"2024-04-25T10:35:19.590175+0000","last_fullsized":"2024-04-25T10:35:19.590175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:16.669213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592361+0000","last_change":"2024-04-25T10:33:43.178426+0000","last_active":"2024-04-25T10:35:19.592361+0000","last_peered":"2024-04-25T10:35:19.592361+0000","last_clean":"2024-04-25T10:35:19.592361+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:35:19.592361+0000","last_undegraded":"2024-04-25T10:35:19.592361+0000","last_fullsized":"2024-04-25T10:35:19.592361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'64","reported_seq":84,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594223+0000","last_change":"2024-04-25T10:33:42.160251+0000","last_active":"2024-04-25T10:35:19.594223+0000","last_peered":"2024-04-25T10:35:19.594223+0000","last_clean":"2024-04-25T10:35:19.594223+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:35:19.594223+0000","last_undegraded":"2024-04-25T10:35:19.594223+0000","last_fullsized":"2024-04-25T10:35:19.594223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620528+0000","last_change":"2024-04-25T10:33:43.180666+0000","last_active":"2024-04-25T10:35:19.620528+0000","last_peered":"2024-04-25T10:35:19.620528+0000","last_clean":"2024-04-25T10:35:19.620528+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:35:19.620528+0000","last_undegraded":"2024-04-25T10:35:19.620528+0000","last_fullsized":"2024-04-25T10:35:19.620528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619569+0000","last_change":"2024-04-25T10:33:42.164005+0000","last_active":"2024-04-25T10:35:19.619569+0000","last_peered":"2024-04-25T10:35:19.619569+0000","last_clean":"2024-04-25T10:35:19.619569+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:35:19.619569+0000","last_undegraded":"2024-04-25T10:35:19.619569+0000","last_fullsized":"2024-04-25T10:35:19.619569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:54.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619404+0000","last_change":"2024-04-25T10:33:43.181483+0000","last_active":"2024-04-25T10:35:19.619404+0000","last_peered":"2024-04-25T10:35:19.619404+0000","last_clean":"2024-04-25T10:35:19.619404+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:35:19.619404+0000","last_undegraded":"2024-04-25T10:35:19.619404+0000","last_fullsized":"2024-04-25T10:35:19.619404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:42.713890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591150+0000","last_change":"2024-04-25T10:33:42.163146+0000","last_active":"2024-04-25T10:35:19.591150+0000","last_peered":"2024-04-25T10:35:19.591150+0000","last_clean":"2024-04-25T10:35:19.591150+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:35:19.591150+0000","last_undegraded":"2024-04-25T10:35:19.591150+0000","last_fullsized":"2024-04-25T10:35:19.591150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620467+0000","last_change":"2024-04-25T10:33:43.183314+0000","last_active":"2024-04-25T10:35:19.620467+0000","last_peered":"2024-04-25T10:35:19.620467+0000","last_clean":"2024-04-25T10:35:19.620467+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:35:19.620467+0000","last_undegraded":"2024-04-25T10:35:19.620467+0000","last_fullsized":"2024-04-25T10:35:19.620467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:07.841471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593969+0000","last_change":"2024-04-25T10:33:42.166542+0000","last_active":"2024-04-25T10:35:19.593969+0000","last_peered":"2024-04-25T10:35:19.593969+0000","last_clean":"2024-04-25T10:35:19.593969+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:35:19.593969+0000","last_undegraded":"2024-04-25T10:35:19.593969+0000","last_fullsized":"2024-04-25T10:35:19.593969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593951+0000","last_change":"2024-04-25T10:33:43.176217+0000","last_active":"2024-04-25T10:35:19.593951+0000","last_peered":"2024-04-25T10:35:19.593951+0000","last_clean":"2024-04-25T10:35:19.593951+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:35:19.593951+0000","last_undegraded":"2024-04-25T10:35:19.593951+0000","last_fullsized":"2024-04-25T10:35:19.593951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620234+0000","last_change":"2024-04-25T10:33:42.156163+0000","last_active":"2024-04-25T10:35:19.620234+0000","last_peered":"2024-04-25T10:35:19.620234+0000","last_clean":"2024-04-25T10:35:19.620234+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:35:19.620234+0000","last_undegraded":"2024-04-25T10:35:19.620234+0000","last_fullsized":"2024-04-25T10:35:19.620234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620303+0000","last_change":"2024-04-25T10:33:43.183091+0000","last_active":"2024-04-25T10:35:19.620303+0000","last_peered":"2024-04-25T10:35:19.620303+0000","last_clean":"2024-04-25T10:35:19.620303+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:35:19.620303+0000","last_undegraded":"2024-04-25T10:35:19.620303+0000","last_fullsized":"2024-04-25T10:35:19.620303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592323+0000","last_change":"2024-04-25T10:33:42.162393+0000","last_active":"2024-04-25T10:35:19.592323+0000","last_peered":"2024-04-25T10:35:19.592323+0000","last_clean":"2024-04-25T10:35:19.592323+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:35:19.592323+0000","last_undegraded":"2024-04-25T10:35:19.592323+0000","last_fullsized":"2024-04-25T10:35:19.592323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:57.969551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620466+0000","last_change":"2024-04-25T10:34:24.298321+0000","last_active":"2024-04-25T10:35:19.620466+0000","last_peered":"2024-04-25T10:35:19.620466+0000","last_clean":"2024-04-25T10:35:19.620466+0000","last_became_active":"2024-04-25T10:34:24.298059+0000","last_became_peered":"2024-04-25T10:34:24.298059+0000","last_unstale":"2024-04-25T10:35:19.620466+0000","last_undegraded":"2024-04-25T10:35:19.620466+0000","last_fullsized":"2024-04-25T10:35:19.620466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620569+0000","last_change":"2024-04-25T10:33:42.159468+0000","last_active":"2024-04-25T10:35:19.620569+0000","last_peered":"2024-04-25T10:35:19.620569+0000","last_clean":"2024-04-25T10:35:19.620569+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:35:19.620569+0000","last_undegraded":"2024-04-25T10:35:19.620569+0000","last_fullsized":"2024-04-25T10:35:19.620569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620855+0000","last_change":"2024-04-25T10:33:43.181841+0000","last_active":"2024-04-25T10:35:19.620855+0000","last_peered":"2024-04-25T10:35:19.620855+0000","last_clean":"2024-04-25T10:35:19.620855+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:35:19.620855+0000","last_undegraded":"2024-04-25T10:35:19.620855+0000","last_fullsized":"2024-04-25T10:35:19.620855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:37.937673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590270+0000","last_change":"2024-04-25T10:33:42.152094+0000","last_active":"2024-04-25T10:35:19.590270+0000","last_peered":"2024-04-25T10:35:19.590270+0000","last_clean":"2024-04-25T10:35:19.590270+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:35:19.590270+0000","last_undegraded":"2024-04-25T10:35:19.590270+0000","last_fullsized":"2024-04-25T10:35:19.590270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.924435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620343+0000","last_change":"2024-04-25T10:34:24.299747+0000","last_active":"2024-04-25T10:35:19.620343+0000","last_peered":"2024-04-25T10:35:19.620343+0000","last_clean":"2024-04-25T10:35:19.620343+0000","last_became_active":"2024-04-25T10:34:24.299411+0000","last_became_peered":"2024-04-25T10:34:24.299411+0000","last_unstale":"2024-04-25T10:35:19.620343+0000","last_undegraded":"2024-04-25T10:35:19.620343+0000","last_fullsized":"2024-04-25T10:35:19.620343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620411+0000","last_change":"2024-04-25T10:33:42.167140+0000","last_active":"2024-04-25T10:35:19.620411+0000","last_peered":"2024-04-25T10:35:19.620411+0000","last_clean":"2024-04-25T10:35:19.620411+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:35:19.620411+0000","last_undegraded":"2024-04-25T10:35:19.620411+0000","last_fullsized":"2024-04-25T10:35:19.620411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620535+0000","last_change":"2024-04-25T10:33:43.184750+0000","last_active":"2024-04-25T10:35:19.620535+0000","last_peered":"2024-04-25T10:35:19.620535+0000","last_clean":"2024-04-25T10:35:19.620535+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:35:19.620535+0000","last_undegraded":"2024-04-25T10:35:19.620535+0000","last_fullsized":"2024-04-25T10:35:19.620535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620399+0000","last_change":"2024-04-25T10:33:31.708843+0000","last_active":"2024-04-25T10:35:19.620399+0000","last_peered":"2024-04-25T10:35:19.620399+0000","last_clean":"2024-04-25T10:35:19.620399+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:35:19.620399+0000","last_undegraded":"2024-04-25T10:35:19.620399+0000","last_fullsized":"2024-04-25T10:35:19.620399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_clean_scrub_stamp":"2024-04-25T10:33:30.626866+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:10.475782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591077+0000","last_change":"2024-04-25T10:33:42.164505+0000","last_active":"2024-04-25T10:35:19.591077+0000","last_peered":"2024-04-25T10:35:19.591077+0000","last_clean":"2024-04-25T10:35:19.591077+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:35:19.591077+0000","last_undegraded":"2024-04-25T10:35:19.591077+0000","last_fullsized":"2024-04-25T10:35:19.591077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599426+0000","last_change":"2024-04-25T10:33:43.169958+0000","last_active":"2024-04-25T10:35:19.599426+0000","last_peered":"2024-04-25T10:35:19.599426+0000","last_clean":"2024-04-25T10:35:19.599426+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:35:19.599426+0000","last_undegraded":"2024-04-25T10:35:19.599426+0000","last_fullsized":"2024-04-25T10:35:19.599426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620280+0000","last_change":"2024-04-25T10:33:42.163852+0000","last_active":"2024-04-25T10:35:19.620280+0000","last_peered":"2024-04-25T10:35:19.620280+0000","last_clean":"2024-04-25T10:35:19.620280+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:35:19.620280+0000","last_undegraded":"2024-04-25T10:35:19.620280+0000","last_fullsized":"2024-04-25T10:35:19.620280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:28.602376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619188+0000","last_change":"2024-04-25T10:33:43.165039+0000","last_active":"2024-04-25T10:35:19.619188+0000","last_peered":"2024-04-25T10:35:19.619188+0000","last_clean":"2024-04-25T10:35:19.619188+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:35:19.619188+0000","last_undegraded":"2024-04-25T10:35:19.619188+0000","last_fullsized":"2024-04-25T10:35:19.619188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:30.822807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620386+0000","last_change":"2024-04-25T10:33:42.160012+0000","last_active":"2024-04-25T10:35:19.620386+0000","last_peered":"2024-04-25T10:35:19.620386+0000","last_clean":"2024-04-25T10:35:19.620386+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:35:19.620386+0000","last_undegraded":"2024-04-25T10:35:19.620386+0000","last_fullsized":"2024-04-25T10:35:19.620386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590040+0000","last_change":"2024-04-25T10:33:43.170473+0000","last_active":"2024-04-25T10:35:19.590040+0000","last_peered":"2024-04-25T10:35:19.590040+0000","last_clean":"2024-04-25T10:35:19.590040+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:35:19.590040+0000","last_undegraded":"2024-04-25T10:35:19.590040+0000","last_fullsized":"2024-04-25T10:35:19.590040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591243+0000","last_change":"2024-04-25T10:33:42.161197+0000","last_active":"2024-04-25T10:35:19.591243+0000","last_peered":"2024-04-25T10:35:19.591243+0000","last_clean":"2024-04-25T10:35:19.591243+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:35:19.591243+0000","last_undegraded":"2024-04-25T10:35:19.591243+0000","last_fullsized":"2024-04-25T10:35:19.591243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592261+0000","last_change":"2024-04-25T10:33:43.172447+0000","last_active":"2024-04-25T10:35:19.592261+0000","last_peered":"2024-04-25T10:35:19.592261+0000","last_clean":"2024-04-25T10:35:19.592261+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:35:19.592261+0000","last_undegraded":"2024-04-25T10:35:19.592261+0000","last_fullsized":"2024-04-25T10:35:19.592261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:19.195134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590171+0000","last_change":"2024-04-25T10:33:42.161100+0000","last_active":"2024-04-25T10:35:19.590171+0000","last_peered":"2024-04-25T10:35:19.590171+0000","last_clean":"2024-04-25T10:35:19.590171+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:35:19.590171+0000","last_undegraded":"2024-04-25T10:35:19.590171+0000","last_fullsized":"2024-04-25T10:35:19.590171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591604+0000","last_change":"2024-04-25T10:33:43.175361+0000","last_active":"2024-04-25T10:35:19.591604+0000","last_peered":"2024-04-25T10:35:19.591604+0000","last_clean":"2024-04-25T10:35:19.591604+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:35:19.591604+0000","last_undegraded":"2024-04-25T10:35:19.591604+0000","last_fullsized":"2024-04-25T10:35:19.591604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620761+0000","last_change":"2024-04-25T10:33:42.170292+0000","last_active":"2024-04-25T10:35:19.620761+0000","last_peered":"2024-04-25T10:35:19.620761+0000","last_clean":"2024-04-25T10:35:19.620761+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:35:19.620761+0000","last_undegraded":"2024-04-25T10:35:19.620761+0000","last_fullsized":"2024-04-25T10:35:19.620761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:47.392698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590121+0000","last_change":"2024-04-25T10:33:43.170285+0000","last_active":"2024-04-25T10:35:19.590121+0000","last_peered":"2024-04-25T10:35:19.590121+0000","last_clean":"2024-04-25T10:35:19.590121+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:35:19.590121+0000","last_undegraded":"2024-04-25T10:35:19.590121+0000","last_fullsized":"2024-04-25T10:35:19.590121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590454+0000","last_change":"2024-04-25T10:33:42.160069+0000","last_active":"2024-04-25T10:35:19.590454+0000","last_peered":"2024-04-25T10:35:19.590454+0000","last_clean":"2024-04-25T10:35:19.590454+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:35:19.590454+0000","last_undegraded":"2024-04-25T10:35:19.590454+0000","last_fullsized":"2024-04-25T10:35:19.590454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599709+0000","last_change":"2024-04-25T10:33:43.181641+0000","last_active":"2024-04-25T10:35:19.599709+0000","last_peered":"2024-04-25T10:35:19.599709+0000","last_clean":"2024-04-25T10:35:19.599709+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:35:19.599709+0000","last_undegraded":"2024-04-25T10:35:19.599709+0000","last_fullsized":"2024-04-25T10:35:19.599709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594344+0000","last_change":"2024-04-25T10:33:42.165706+0000","last_active":"2024-04-25T10:35:19.594344+0000","last_peered":"2024-04-25T10:35:19.594344+0000","last_clean":"2024-04-25T10:35:19.594344+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:35:19.594344+0000","last_undegraded":"2024-04-25T10:35:19.594344+0000","last_fullsized":"2024-04-25T10:35:19.594344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619615+0000","last_change":"2024-04-25T10:33:43.173260+0000","last_active":"2024-04-25T10:35:19.619615+0000","last_peered":"2024-04-25T10:35:19.619615+0000","last_clean":"2024-04-25T10:35:19.619615+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:35:19.619615+0000","last_undegraded":"2024-04-25T10:35:19.619615+0000","last_fullsized":"2024-04-25T10:35:19.619615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620263+0000","last_change":"2024-04-25T10:33:42.166946+0000","last_active":"2024-04-25T10:35:19.620263+0000","last_peered":"2024-04-25T10:35:19.620263+0000","last_clean":"2024-04-25T10:35:19.620263+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:35:19.620263+0000","last_undegraded":"2024-04-25T10:35:19.620263+0000","last_fullsized":"2024-04-25T10:35:19.620263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:29.817932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592050+0000","last_change":"2024-04-25T10:33:43.170510+0000","last_active":"2024-04-25T10:35:19.592050+0000","last_peered":"2024-04-25T10:35:19.592050+0000","last_clean":"2024-04-25T10:35:19.592050+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:35:19.592050+0000","last_undegraded":"2024-04-25T10:35:19.592050+0000","last_fullsized":"2024-04-25T10:35:19.592050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590156+0000","last_change":"2024-04-25T10:33:42.165204+0000","last_active":"2024-04-25T10:35:19.590156+0000","last_peered":"2024-04-25T10:35:19.590156+0000","last_clean":"2024-04-25T10:35:19.590156+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:35:19.590156+0000","last_undegraded":"2024-04-25T10:35:19.590156+0000","last_fullsized":"2024-04-25T10:35:19.590156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599436+0000","last_change":"2024-04-25T10:33:43.168088+0000","last_active":"2024-04-25T10:35:19.599436+0000","last_peered":"2024-04-25T10:35:19.599436+0000","last_clean":"2024-04-25T10:35:19.599436+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:35:19.599436+0000","last_undegraded":"2024-04-25T10:35:19.599436+0000","last_fullsized":"2024-04-25T10:35:19.599436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590347+0000","last_change":"2024-04-25T10:33:42.156381+0000","last_active":"2024-04-25T10:35:19.590347+0000","last_peered":"2024-04-25T10:35:19.590347+0000","last_clean":"2024-04-25T10:35:19.590347+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:35:19.590347+0000","last_undegraded":"2024-04-25T10:35:19.590347+0000","last_fullsized":"2024-04-25T10:35:19.590347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599508+0000","last_change":"2024-04-25T10:33:43.167502+0000","last_active":"2024-04-25T10:35:19.599508+0000","last_peered":"2024-04-25T10:35:19.599508+0000","last_clean":"2024-04-25T10:35:19.599508+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:35:19.599508+0000","last_undegraded":"2024-04-25T10:35:19.599508+0000","last_fullsized":"2024-04-25T10:35:19.599508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620596+0000","last_change":"2024-04-25T10:33:42.168840+0000","last_active":"2024-04-25T10:35:19.620596+0000","last_peered":"2024-04-25T10:35:19.620596+0000","last_clean":"2024-04-25T10:35:19.620596+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:35:19.620596+0000","last_undegraded":"2024-04-25T10:35:19.620596+0000","last_fullsized":"2024-04-25T10:35:19.620596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:51.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593984+0000","last_change":"2024-04-25T10:33:43.174672+0000","last_active":"2024-04-25T10:35:19.593984+0000","last_peered":"2024-04-25T10:35:19.593984+0000","last_clean":"2024-04-25T10:35:19.593984+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:35:19.593984+0000","last_undegraded":"2024-04-25T10:35:19.593984+0000","last_fullsized":"2024-04-25T10:35:19.593984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591576+0000","last_change":"2024-04-25T10:33:43.179274+0000","last_active":"2024-04-25T10:35:19.591576+0000","last_peered":"2024-04-25T10:35:19.591576+0000","last_clean":"2024-04-25T10:35:19.591576+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:35:19.591576+0000","last_undegraded":"2024-04-25T10:35:19.591576+0000","last_fullsized":"2024-04-25T10:35:19.591576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:24.341521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620487+0000","last_change":"2024-04-25T10:33:42.168654+0000","last_active":"2024-04-25T10:35:19.620487+0000","last_peered":"2024-04-25T10:35:19.620487+0000","last_clean":"2024-04-25T10:35:19.620487+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:35:19.620487+0000","last_undegraded":"2024-04-25T10:35:19.620487+0000","last_fullsized":"2024-04-25T10:35:19.620487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:15.158541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591205+0000","last_change":"2024-04-25T10:33:43.170923+0000","last_active":"2024-04-25T10:35:19.591205+0000","last_peered":"2024-04-25T10:35:19.591205+0000","last_clean":"2024-04-25T10:35:19.591205+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:35:19.591205+0000","last_undegraded":"2024-04-25T10:35:19.591205+0000","last_fullsized":"2024-04-25T10:35:19.591205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620653+0000","last_change":"2024-04-25T10:33:42.171374+0000","last_active":"2024-04-25T10:35:19.620653+0000","last_peered":"2024-04-25T10:35:19.620653+0000","last_clean":"2024-04-25T10:35:19.620653+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:35:19.620653+0000","last_undegraded":"2024-04-25T10:35:19.620653+0000","last_fullsized":"2024-04-25T10:35:19.620653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:41.709015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619407+0000","last_change":"2024-04-25T10:33:43.172788+0000","last_active":"2024-04-25T10:35:19.619407+0000","last_peered":"2024-04-25T10:35:19.619407+0000","last_clean":"2024-04-25T10:35:19.619407+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:35:19.619407+0000","last_undegraded":"2024-04-25T10:35:19.619407+0000","last_fullsized":"2024-04-25T10:35:19.619407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599727+0000","last_change":"2024-04-25T10:33:42.161364+0000","last_active":"2024-04-25T10:35:19.599727+0000","last_peered":"2024-04-25T10:35:19.599727+0000","last_clean":"2024-04-25T10:35:19.599727+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:35:19.599727+0000","last_undegraded":"2024-04-25T10:35:19.599727+0000","last_fullsized":"2024-04-25T10:35:19.599727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599690+0000","last_change":"2024-04-25T10:33:43.177654+0000","last_active":"2024-04-25T10:35:19.599690+0000","last_peered":"2024-04-25T10:35:19.599690+0000","last_clean":"2024-04-25T10:35:19.599690+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:35:19.599690+0000","last_undegraded":"2024-04-25T10:35:19.599690+0000","last_fullsized":"2024-04-25T10:35:19.599690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619679+0000","last_change":"2024-04-25T10:33:42.167156+0000","last_active":"2024-04-25T10:35:19.619679+0000","last_peered":"2024-04-25T10:35:19.619679+0000","last_clean":"2024-04-25T10:35:19.619679+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:35:19.619679+0000","last_undegraded":"2024-04-25T10:35:19.619679+0000","last_fullsized":"2024-04-25T10:35:19.619679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68881,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":109,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":137762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":680177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":156603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":89317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":89353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":157310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":89387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":680233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:35:25.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:35:25.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.221+0000 7fddcb327640 1 Processor -- start 2024-04-25T10:35:25.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.221+0000 7fddcb327640 1 -- start start 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.222+0000 7fddcb327640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc4074130 0x7fddc40b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.222+0000 7fddcb327640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc40734d0 con 0x7fddc40b5070 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.222+0000 7fddcb327640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc40737b0 con 0x7fddc40b7540 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.222+0000 7fddcb327640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fddc4073f90 con 0x7fddc4074130 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddc98c4640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fddc40b5070 0x7fddc4141100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48258/0 (socket says 172.21.15.103:48258) 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddc98c4640 1 -- 172.21.15.103:0/4116123983 learned_addr learned my addr 172.21.15.103:0/4116123983 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddc88c2640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc4074130 0x7fddc40b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102884984 0 0) 0x7fddc40734d0 con 0x7fddc40b5070 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddb0003520 con 0x7fddc40b5070 2024-04-25T10:35:25.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3884069295 0 0) 0x7fddb0003520 con 0x7fddc40b5070 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc4074130 msgr2=0x7fddc40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc4074130 0x7fddc40b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 >> v1:172.21.15.132:6789/0 conn(0x7fddc40b7540 legacy=0x7fddc4072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc4073a90 con 0x7fddc40b5070 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fddbc001670 con 0x7fddc40b5070 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 >> v1:172.21.15.103:6789/0 conn(0x7fddc40b5070 legacy=0x7fddc4141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc4074130 0x7fddb00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb0003f40 0x7fddb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb0004d40 0x7fddb0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4073f90 con 0x7fddb0004d40 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fddb000bb80 con 0x7fddb0003f40 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fddb000bd80 con 0x7fddc4074130 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddc98c4640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb0004d40 0x7fddb0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddc90c3640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc4074130 0x7fddb00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.223+0000 7fddc88c2640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb0003f40 0x7fddb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.224+0000 7fddc98c4640 1 -- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc4074130 msgr2=0x7fddb00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.224+0000 7fddc98c4640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc4074130 0x7fddb00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.224+0000 7fddc98c4640 1 -- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb0003f40 msgr2=0x7fddb0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.224+0000 7fddc98c4640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb0003f40 0x7fddb0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.224+0000 7fddc98c4640 1 -- 172.21.15.103:0/4116123983 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb0003520 con 0x7fddb0004d40 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.224+0000 7fddc98c4640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb0004d40 0x7fddb0005150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00c210 tx=0x7fddb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab83d03007a57aff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.224+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc007d30 con 0x7fddb0004d40 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc0058d0 con 0x7fddb0004d40 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddbbfff640 1 -- 172.21.15.103:0/4116123983 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc005d20 con 0x7fddb0004d40 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddcb327640 1 -- 172.21.15.103:0/4116123983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb0004d40 msgr2=0x7fddb0005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddcb327640 1 --2- 172.21.15.103:0/4116123983 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddb0004d40 0x7fddb0005150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00c210 tx=0x7fddb0005830 comp rx=0 tx=0).stop 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddc98c4640 1 -- 172.21.15.103:0/4116123983 reap_dead start 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddcb327640 1 -- 172.21.15.103:0/4116123983 shutdown_connections 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddcb327640 1 -- 172.21.15.103:0/4116123983 >> 172.21.15.103:0/4116123983 conn(0x7fddc40bc170 msgr2=0x7fddc406d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:25.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddcb327640 1 -- 172.21.15.103:0/4116123983 shutdown_connections 2024-04-25T10:35:25.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.225+0000 7fddcb327640 1 -- 172.21.15.103:0/4116123983 wait complete. 2024-04-25T10:35:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.227+0000 7fddcb327640 1 Processor -- start 2024-04-25T10:35:25.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.227+0000 7fddcb327640 1 -- start start 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddcb327640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc40b3840 0x7fddc40aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddcb327640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc40b3db0 0x7fddc40ba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddcb327640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc40aeb90 0x7fddc413c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddcb327640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4141990 con 0x7fddc40b3db0 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddcb327640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4141810 con 0x7fddc40b3840 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddcb327640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fddc4141b10 con 0x7fddc40aeb90 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc40b3db0 0x7fddc40ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc40b3db0 0x7fddc40ba8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50678/0 (socket says 172.21.15.103:50678) 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 -- 172.21.15.103:0/2892654429 learned_addr learned my addr 172.21.15.103:0/2892654429 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc98c4640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc40aeb90 0x7fddc413c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc90c3640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc40b3840 0x7fddc40aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 -- 172.21.15.103:0/2892654429 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc40aeb90 msgr2=0x7fddc413c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc40aeb90 0x7fddc413c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 -- 172.21.15.103:0/2892654429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc40b3840 msgr2=0x7fddc40aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc40b3840 0x7fddc40aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 -- 172.21.15.103:0/2892654429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc40b41c0 con 0x7fddc40b3db0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddc88c2640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc40b3db0 0x7fddc40ba8e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fddb4011990 tx=0x7fddb4011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddb9ffb640 1 -- 172.21.15.103:0/2892654429 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4019070 con 0x7fddc40b3db0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddb9ffb640 1 -- 172.21.15.103:0/2892654429 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb4004240 con 0x7fddc40b3db0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddb9ffb640 1 -- 172.21.15.103:0/2892654429 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb400f860 con 0x7fddc40b3db0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.228+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc40b4480 con 0x7fddc40b3db0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.229+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc40aefa0 con 0x7fddc40b3db0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.230+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc40b6dd0 con 0x7fddc40b3db0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.230+0000 7fddb9ffb640 1 -- 172.21.15.103:0/2892654429 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fddb401c070 con 0x7fddc40b3db0 2024-04-25T10:35:25.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.231+0000 7fddb9ffb640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdda80744b0 0x7fdda80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.231+0000 7fddc90c3640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdda80744b0 0x7fdda80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.231+0000 7fddb9ffb640 1 -- 172.21.15.103:0/2892654429 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fddb40956a0 con 0x7fddc40b3db0 2024-04-25T10:35:25.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.231+0000 7fddc90c3640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdda80744b0 0x7fdda80769c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddc41e05f0 tx=0x7fddc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.235+0000 7fddb9ffb640 1 -- 172.21.15.103:0/2892654429 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fddc40b6dd0 con 0x7fddc40b3db0 2024-04-25T10:35:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.408+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fddc4073d70 con 0x7fdda80744b0 2024-04-25T10:35:25.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.414+0000 7fddb9ffb640 1 -- 172.21.15.103:0/2892654429 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251861 (secure 0 0 0) 0x7fddc4073d70 con 0x7fdda80744b0 2024-04-25T10:35:25.418 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:35:25.419 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:35:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdda80744b0 msgr2=0x7fdda80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdda80744b0 0x7fdda80769c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddc41e05f0 tx=0x7fddc0009040 comp rx=0 tx=0).stop 2024-04-25T10:35:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc40b3db0 msgr2=0x7fddc40ba8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc40b3db0 0x7fddc40ba8e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fddb4011990 tx=0x7fddb4011e50 comp rx=0 tx=0).stop 2024-04-25T10:35:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 shutdown_connections 2024-04-25T10:35:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdda80744b0 0x7fdda80769c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fddc40aeb90 0x7fddc413c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddc40b3db0 0x7fddc40ba8e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 --2- 172.21.15.103:0/2892654429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc40b3840 0x7fddc40aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 >> 172.21.15.103:0/2892654429 conn(0x7fddc40bc170 msgr2=0x7fddc40b8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:25.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 shutdown_connections 2024-04-25T10:35:25.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.417+0000 7fddcb327640 1 -- 172.21.15.103:0/2892654429 wait complete. 2024-04-25T10:35:25.430 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-25T10:35:24.515380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659249,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":218,"num_write_kb":1748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219396,"kb_used_data":3236,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755324,"statfs":{"total":773094113280,"available":772869451776,"internally_reserved":0,"allocated":3313664,"data_stored":2026203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":66471,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":72,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002178"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620741+0000","last_change":"2024-04-25T10:33:43.181183+0000","last_active":"2024-04-25T10:35:19.620741+0000","last_peered":"2024-04-25T10:35:19.620741+0000","last_clean":"2024-04-25T10:35:19.620741+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:35:19.620741+0000","last_undegraded":"2024-04-25T10:35:19.620741+0000","last_fullsized":"2024-04-25T10:35:19.620741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:44.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590380+0000","last_change":"2024-04-25T10:33:43.170436+0000","last_active":"2024-04-25T10:35:19.590380+0000","last_peered":"2024-04-25T10:35:19.590380+0000","last_clean":"2024-04-25T10:35:19.590380+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:35:19.590380+0000","last_undegraded":"2024-04-25T10:35:19.590380+0000","last_fullsized":"2024-04-25T10:35:19.590380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619458+0000","last_change":"2024-04-25T10:33:43.181271+0000","last_active":"2024-04-25T10:35:19.619458+0000","last_peered":"2024-04-25T10:35:19.619458+0000","last_clean":"2024-04-25T10:35:19.619458+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:35:19.619458+0000","last_undegraded":"2024-04-25T10:35:19.619458+0000","last_fullsized":"2024-04-25T10:35:19.619458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591102+0000","last_change":"2024-04-25T10:33:43.176831+0000","last_active":"2024-04-25T10:35:19.591102+0000","last_peered":"2024-04-25T10:35:19.591102+0000","last_clean":"2024-04-25T10:35:19.591102+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:35:19.591102+0000","last_undegraded":"2024-04-25T10:35:19.591102+0000","last_fullsized":"2024-04-25T10:35:19.591102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620456+0000","last_change":"2024-04-25T10:33:43.181222+0000","last_active":"2024-04-25T10:35:19.620456+0000","last_peered":"2024-04-25T10:35:19.620456+0000","last_clean":"2024-04-25T10:35:19.620456+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:35:19.620456+0000","last_undegraded":"2024-04-25T10:35:19.620456+0000","last_fullsized":"2024-04-25T10:35:19.620456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:42.544249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590996+0000","last_change":"2024-04-25T10:33:43.175444+0000","last_active":"2024-04-25T10:35:19.590996+0000","last_peered":"2024-04-25T10:35:19.590996+0000","last_clean":"2024-04-25T10:35:19.590996+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:35:19.590996+0000","last_undegraded":"2024-04-25T10:35:19.590996+0000","last_fullsized":"2024-04-25T10:35:19.590996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620299+0000","last_change":"2024-04-25T10:33:43.186303+0000","last_active":"2024-04-25T10:35:19.620299+0000","last_peered":"2024-04-25T10:35:19.620299+0000","last_clean":"2024-04-25T10:35:19.620299+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:35:19.620299+0000","last_undegraded":"2024-04-25T10:35:19.620299+0000","last_fullsized":"2024-04-25T10:35:19.620299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599277+0000","last_change":"2024-04-25T10:33:43.169919+0000","last_active":"2024-04-25T10:35:19.599277+0000","last_peered":"2024-04-25T10:35:19.599277+0000","last_clean":"2024-04-25T10:35:19.599277+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:35:19.599277+0000","last_undegraded":"2024-04-25T10:35:19.599277+0000","last_fullsized":"2024-04-25T10:35:19.599277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620817+0000","last_change":"2024-04-25T10:34:24.321277+0000","last_active":"2024-04-25T10:35:19.620817+0000","last_peered":"2024-04-25T10:35:19.620817+0000","last_clean":"2024-04-25T10:35:19.620817+0000","last_became_active":"2024-04-25T10:34:24.320939+0000","last_became_peered":"2024-04-25T10:34:24.320939+0000","last_unstale":"2024-04-25T10:35:19.620817+0000","last_undegraded":"2024-04-25T10:35:19.620817+0000","last_fullsized":"2024-04-25T10:35:19.620817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:35.139675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594280+0000","last_change":"2024-04-25T10:33:43.175552+0000","last_active":"2024-04-25T10:35:19.594280+0000","last_peered":"2024-04-25T10:35:19.594280+0000","last_clean":"2024-04-25T10:35:19.594280+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:35:19.594280+0000","last_undegraded":"2024-04-25T10:35:19.594280+0000","last_fullsized":"2024-04-25T10:35:19.594280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594215+0000","last_change":"2024-04-25T10:33:43.175526+0000","last_active":"2024-04-25T10:35:19.594215+0000","last_peered":"2024-04-25T10:35:19.594215+0000","last_clean":"2024-04-25T10:35:19.594215+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:35:19.594215+0000","last_undegraded":"2024-04-25T10:35:19.594215+0000","last_fullsized":"2024-04-25T10:35:19.594215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592368+0000","last_change":"2024-04-25T10:33:43.176506+0000","last_active":"2024-04-25T10:35:19.592368+0000","last_peered":"2024-04-25T10:35:19.592368+0000","last_clean":"2024-04-25T10:35:19.592368+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:35:19.592368+0000","last_undegraded":"2024-04-25T10:35:19.592368+0000","last_fullsized":"2024-04-25T10:35:19.592368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:54.213946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599412+0000","last_change":"2024-04-25T10:33:43.178091+0000","last_active":"2024-04-25T10:35:19.599412+0000","last_peered":"2024-04-25T10:35:19.599412+0000","last_clean":"2024-04-25T10:35:19.599412+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:35:19.599412+0000","last_undegraded":"2024-04-25T10:35:19.599412+0000","last_fullsized":"2024-04-25T10:35:19.599412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'2","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619231+0000","last_change":"2024-04-25T10:33:43.173440+0000","last_active":"2024-04-25T10:35:19.619231+0000","last_peered":"2024-04-25T10:35:19.619231+0000","last_clean":"2024-04-25T10:35:19.619231+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:35:19.619231+0000","last_undegraded":"2024-04-25T10:35:19.619231+0000","last_fullsized":"2024-04-25T10:35:19.619231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.607252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590008+0000","last_change":"2024-04-25T10:33:43.172566+0000","last_active":"2024-04-25T10:35:19.590008+0000","last_peered":"2024-04-25T10:35:19.590008+0000","last_clean":"2024-04-25T10:35:19.590008+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:35:19.590008+0000","last_undegraded":"2024-04-25T10:35:19.590008+0000","last_fullsized":"2024-04-25T10:35:19.590008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590878+0000","last_change":"2024-04-25T10:33:43.175162+0000","last_active":"2024-04-25T10:35:19.590878+0000","last_peered":"2024-04-25T10:35:19.590878+0000","last_clean":"2024-04-25T10:35:19.590878+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:35:19.590878+0000","last_undegraded":"2024-04-25T10:35:19.590878+0000","last_fullsized":"2024-04-25T10:35:19.590878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591309+0000","last_change":"2024-04-25T10:33:43.183071+0000","last_active":"2024-04-25T10:35:19.591309+0000","last_peered":"2024-04-25T10:35:19.591309+0000","last_clean":"2024-04-25T10:35:19.591309+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:35:19.591309+0000","last_undegraded":"2024-04-25T10:35:19.591309+0000","last_fullsized":"2024-04-25T10:35:19.591309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620468+0000","last_change":"2024-04-25T10:33:43.179022+0000","last_active":"2024-04-25T10:35:19.620468+0000","last_peered":"2024-04-25T10:35:19.620468+0000","last_clean":"2024-04-25T10:35:19.620468+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:35:19.620468+0000","last_undegraded":"2024-04-25T10:35:19.620468+0000","last_fullsized":"2024-04-25T10:35:19.620468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620727+0000","last_change":"2024-04-25T10:33:43.186661+0000","last_active":"2024-04-25T10:35:19.620727+0000","last_peered":"2024-04-25T10:35:19.620727+0000","last_clean":"2024-04-25T10:35:19.620727+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:35:19.620727+0000","last_undegraded":"2024-04-25T10:35:19.620727+0000","last_fullsized":"2024-04-25T10:35:19.620727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.758005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594145+0000","last_change":"2024-04-25T10:33:43.175801+0000","last_active":"2024-04-25T10:35:19.594145+0000","last_peered":"2024-04-25T10:35:19.594145+0000","last_clean":"2024-04-25T10:35:19.594145+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:35:19.594145+0000","last_undegraded":"2024-04-25T10:35:19.594145+0000","last_fullsized":"2024-04-25T10:35:19.594145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619437+0000","last_change":"2024-04-25T10:33:43.183056+0000","last_active":"2024-04-25T10:35:19.619437+0000","last_peered":"2024-04-25T10:35:19.619437+0000","last_clean":"2024-04-25T10:35:19.619437+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:35:19.619437+0000","last_undegraded":"2024-04-25T10:35:19.619437+0000","last_fullsized":"2024-04-25T10:35:19.619437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591030+0000","last_change":"2024-04-25T10:33:43.180388+0000","last_active":"2024-04-25T10:35:19.591030+0000","last_peered":"2024-04-25T10:35:19.591030+0000","last_clean":"2024-04-25T10:35:19.591030+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:35:19.591030+0000","last_undegraded":"2024-04-25T10:35:19.591030+0000","last_fullsized":"2024-04-25T10:35:19.591030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599358+0000","last_change":"2024-04-25T10:33:43.162216+0000","last_active":"2024-04-25T10:35:19.599358+0000","last_peered":"2024-04-25T10:35:19.599358+0000","last_clean":"2024-04-25T10:35:19.599358+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:35:19.599358+0000","last_undegraded":"2024-04-25T10:35:19.599358+0000","last_fullsized":"2024-04-25T10:35:19.599358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590950+0000","last_change":"2024-04-25T10:33:43.183734+0000","last_active":"2024-04-25T10:35:19.590950+0000","last_peered":"2024-04-25T10:35:19.590950+0000","last_clean":"2024-04-25T10:35:19.590950+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:35:19.590950+0000","last_undegraded":"2024-04-25T10:35:19.590950+0000","last_fullsized":"2024-04-25T10:35:19.590950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620538+0000","last_change":"2024-04-25T10:34:24.299795+0000","last_active":"2024-04-25T10:35:19.620538+0000","last_peered":"2024-04-25T10:35:19.620538+0000","last_clean":"2024-04-25T10:35:19.620538+0000","last_became_active":"2024-04-25T10:34:24.299359+0000","last_became_peered":"2024-04-25T10:34:24.299359+0000","last_unstale":"2024-04-25T10:35:19.620538+0000","last_undegraded":"2024-04-25T10:35:19.620538+0000","last_fullsized":"2024-04-25T10:35:19.620538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594381+0000","last_change":"2024-04-25T10:33:43.183648+0000","last_active":"2024-04-25T10:35:19.594381+0000","last_peered":"2024-04-25T10:35:19.594381+0000","last_clean":"2024-04-25T10:35:19.594381+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:35:19.594381+0000","last_undegraded":"2024-04-25T10:35:19.594381+0000","last_fullsized":"2024-04-25T10:35:19.594381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'2","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590117+0000","last_change":"2024-04-25T10:33:43.175229+0000","last_active":"2024-04-25T10:35:19.590117+0000","last_peered":"2024-04-25T10:35:19.590117+0000","last_clean":"2024-04-25T10:35:19.590117+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:35:19.590117+0000","last_undegraded":"2024-04-25T10:35:19.590117+0000","last_fullsized":"2024-04-25T10:35:19.590117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599703+0000","last_change":"2024-04-25T10:33:43.162579+0000","last_active":"2024-04-25T10:35:19.599703+0000","last_peered":"2024-04-25T10:35:19.599703+0000","last_clean":"2024-04-25T10:35:19.599703+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:35:19.599703+0000","last_undegraded":"2024-04-25T10:35:19.599703+0000","last_fullsized":"2024-04-25T10:35:19.599703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619415+0000","last_change":"2024-04-25T10:33:43.168576+0000","last_active":"2024-04-25T10:35:19.619415+0000","last_peered":"2024-04-25T10:35:19.619415+0000","last_clean":"2024-04-25T10:35:19.619415+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:35:19.619415+0000","last_undegraded":"2024-04-25T10:35:19.619415+0000","last_fullsized":"2024-04-25T10:35:19.619415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591110+0000","last_change":"2024-04-25T10:33:43.182970+0000","last_active":"2024-04-25T10:35:19.591110+0000","last_peered":"2024-04-25T10:35:19.591110+0000","last_clean":"2024-04-25T10:35:19.591110+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:35:19.591110+0000","last_undegraded":"2024-04-25T10:35:19.591110+0000","last_fullsized":"2024-04-25T10:35:19.591110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620250+0000","last_change":"2024-04-25T10:33:43.171456+0000","last_active":"2024-04-25T10:35:19.620250+0000","last_peered":"2024-04-25T10:35:19.620250+0000","last_clean":"2024-04-25T10:35:19.620250+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:35:19.620250+0000","last_undegraded":"2024-04-25T10:35:19.620250+0000","last_fullsized":"2024-04-25T10:35:19.620250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593943+0000","last_change":"2024-04-25T10:33:43.183419+0000","last_active":"2024-04-25T10:35:19.593943+0000","last_peered":"2024-04-25T10:35:19.593943+0000","last_clean":"2024-04-25T10:35:19.593943+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:35:19.593943+0000","last_undegraded":"2024-04-25T10:35:19.593943+0000","last_fullsized":"2024-04-25T10:35:19.593943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592007+0000","last_change":"2024-04-25T10:33:43.170134+0000","last_active":"2024-04-25T10:35:19.592007+0000","last_peered":"2024-04-25T10:35:19.592007+0000","last_clean":"2024-04-25T10:35:19.592007+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:35:19.592007+0000","last_undegraded":"2024-04-25T10:35:19.592007+0000","last_fullsized":"2024-04-25T10:35:19.592007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:06.463548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599586+0000","last_change":"2024-04-25T10:33:42.162138+0000","last_active":"2024-04-25T10:35:19.599586+0000","last_peered":"2024-04-25T10:35:19.599586+0000","last_clean":"2024-04-25T10:35:19.599586+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:35:19.599586+0000","last_undegraded":"2024-04-25T10:35:19.599586+0000","last_fullsized":"2024-04-25T10:35:19.599586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619546+0000","last_change":"2024-04-25T10:33:43.172141+0000","last_active":"2024-04-25T10:35:19.619546+0000","last_peered":"2024-04-25T10:35:19.619546+0000","last_clean":"2024-04-25T10:35:19.619546+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:35:19.619546+0000","last_undegraded":"2024-04-25T10:35:19.619546+0000","last_fullsized":"2024-04-25T10:35:19.619546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594071+0000","last_change":"2024-04-25T10:33:42.161614+0000","last_active":"2024-04-25T10:35:19.594071+0000","last_peered":"2024-04-25T10:35:19.594071+0000","last_clean":"2024-04-25T10:35:19.594071+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:35:19.594071+0000","last_undegraded":"2024-04-25T10:35:19.594071+0000","last_fullsized":"2024-04-25T10:35:19.594071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599385+0000","last_change":"2024-04-25T10:33:42.158934+0000","last_active":"2024-04-25T10:35:19.599385+0000","last_peered":"2024-04-25T10:35:19.599385+0000","last_clean":"2024-04-25T10:35:19.599385+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:35:19.599385+0000","last_undegraded":"2024-04-25T10:35:19.599385+0000","last_fullsized":"2024-04-25T10:35:19.599385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599345+0000","last_change":"2024-04-25T10:33:43.170270+0000","last_active":"2024-04-25T10:35:19.599345+0000","last_peered":"2024-04-25T10:35:19.599345+0000","last_clean":"2024-04-25T10:35:19.599345+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:35:19.599345+0000","last_undegraded":"2024-04-25T10:35:19.599345+0000","last_fullsized":"2024-04-25T10:35:19.599345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591039+0000","last_change":"2024-04-25T10:33:42.162167+0000","last_active":"2024-04-25T10:35:19.591039+0000","last_peered":"2024-04-25T10:35:19.591039+0000","last_clean":"2024-04-25T10:35:19.591039+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:35:19.591039+0000","last_undegraded":"2024-04-25T10:35:19.591039+0000","last_fullsized":"2024-04-25T10:35:19.591039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590003+0000","last_change":"2024-04-25T10:33:43.174366+0000","last_active":"2024-04-25T10:35:19.590003+0000","last_peered":"2024-04-25T10:35:19.590003+0000","last_clean":"2024-04-25T10:35:19.590003+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:35:19.590003+0000","last_undegraded":"2024-04-25T10:35:19.590003+0000","last_fullsized":"2024-04-25T10:35:19.590003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594335+0000","last_change":"2024-04-25T10:33:42.163161+0000","last_active":"2024-04-25T10:35:19.594335+0000","last_peered":"2024-04-25T10:35:19.594335+0000","last_clean":"2024-04-25T10:35:19.594335+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:35:19.594335+0000","last_undegraded":"2024-04-25T10:35:19.594335+0000","last_fullsized":"2024-04-25T10:35:19.594335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591501+0000","last_change":"2024-04-25T10:33:43.179159+0000","last_active":"2024-04-25T10:35:19.591501+0000","last_peered":"2024-04-25T10:35:19.591501+0000","last_clean":"2024-04-25T10:35:19.591501+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:35:19.591501+0000","last_undegraded":"2024-04-25T10:35:19.591501+0000","last_fullsized":"2024-04-25T10:35:19.591501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591501+0000","last_change":"2024-04-25T10:33:42.168608+0000","last_active":"2024-04-25T10:35:19.591501+0000","last_peered":"2024-04-25T10:35:19.591501+0000","last_clean":"2024-04-25T10:35:19.591501+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:35:19.591501+0000","last_undegraded":"2024-04-25T10:35:19.591501+0000","last_fullsized":"2024-04-25T10:35:19.591501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619569+0000","last_change":"2024-04-25T10:33:43.172553+0000","last_active":"2024-04-25T10:35:19.619569+0000","last_peered":"2024-04-25T10:35:19.619569+0000","last_clean":"2024-04-25T10:35:19.619569+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:35:19.619569+0000","last_undegraded":"2024-04-25T10:35:19.619569+0000","last_fullsized":"2024-04-25T10:35:19.619569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590175+0000","last_change":"2024-04-25T10:33:42.160656+0000","last_active":"2024-04-25T10:35:19.590175+0000","last_peered":"2024-04-25T10:35:19.590175+0000","last_clean":"2024-04-25T10:35:19.590175+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:35:19.590175+0000","last_undegraded":"2024-04-25T10:35:19.590175+0000","last_fullsized":"2024-04-25T10:35:19.590175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:16.669213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592361+0000","last_change":"2024-04-25T10:33:43.178426+0000","last_active":"2024-04-25T10:35:19.592361+0000","last_peered":"2024-04-25T10:35:19.592361+0000","last_clean":"2024-04-25T10:35:19.592361+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:35:19.592361+0000","last_undegraded":"2024-04-25T10:35:19.592361+0000","last_fullsized":"2024-04-25T10:35:19.592361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'64","reported_seq":84,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594223+0000","last_change":"2024-04-25T10:33:42.160251+0000","last_active":"2024-04-25T10:35:19.594223+0000","last_peered":"2024-04-25T10:35:19.594223+0000","last_clean":"2024-04-25T10:35:19.594223+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:35:19.594223+0000","last_undegraded":"2024-04-25T10:35:19.594223+0000","last_fullsized":"2024-04-25T10:35:19.594223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620528+0000","last_change":"2024-04-25T10:33:43.180666+0000","last_active":"2024-04-25T10:35:19.620528+0000","last_peered":"2024-04-25T10:35:19.620528+0000","last_clean":"2024-04-25T10:35:19.620528+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:35:19.620528+0000","last_undegraded":"2024-04-25T10:35:19.620528+0000","last_fullsized":"2024-04-25T10:35:19.620528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619569+0000","last_change":"2024-04-25T10:33:42.164005+0000","last_active":"2024-04-25T10:35:19.619569+0000","last_peered":"2024-04-25T10:35:19.619569+0000","last_clean":"2024-04-25T10:35:19.619569+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:35:19.619569+0000","last_undegraded":"2024-04-25T10:35:19.619569+0000","last_fullsized":"2024-04-25T10:35:19.619569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:54.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619404+0000","last_change":"2024-04-25T10:33:43.181483+0000","last_active":"2024-04-25T10:35:19.619404+0000","last_peered":"2024-04-25T10:35:19.619404+0000","last_clean":"2024-04-25T10:35:19.619404+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:35:19.619404+0000","last_undegraded":"2024-04-25T10:35:19.619404+0000","last_fullsized":"2024-04-25T10:35:19.619404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:42.713890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591150+0000","last_change":"2024-04-25T10:33:42.163146+0000","last_active":"2024-04-25T10:35:19.591150+0000","last_peered":"2024-04-25T10:35:19.591150+0000","last_clean":"2024-04-25T10:35:19.591150+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:35:19.591150+0000","last_undegraded":"2024-04-25T10:35:19.591150+0000","last_fullsized":"2024-04-25T10:35:19.591150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620467+0000","last_change":"2024-04-25T10:33:43.183314+0000","last_active":"2024-04-25T10:35:19.620467+0000","last_peered":"2024-04-25T10:35:19.620467+0000","last_clean":"2024-04-25T10:35:19.620467+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:35:19.620467+0000","last_undegraded":"2024-04-25T10:35:19.620467+0000","last_fullsized":"2024-04-25T10:35:19.620467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:07.841471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593969+0000","last_change":"2024-04-25T10:33:42.166542+0000","last_active":"2024-04-25T10:35:19.593969+0000","last_peered":"2024-04-25T10:35:19.593969+0000","last_clean":"2024-04-25T10:35:19.593969+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:35:19.593969+0000","last_undegraded":"2024-04-25T10:35:19.593969+0000","last_fullsized":"2024-04-25T10:35:19.593969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593951+0000","last_change":"2024-04-25T10:33:43.176217+0000","last_active":"2024-04-25T10:35:19.593951+0000","last_peered":"2024-04-25T10:35:19.593951+0000","last_clean":"2024-04-25T10:35:19.593951+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:35:19.593951+0000","last_undegraded":"2024-04-25T10:35:19.593951+0000","last_fullsized":"2024-04-25T10:35:19.593951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620234+0000","last_change":"2024-04-25T10:33:42.156163+0000","last_active":"2024-04-25T10:35:19.620234+0000","last_peered":"2024-04-25T10:35:19.620234+0000","last_clean":"2024-04-25T10:35:19.620234+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:35:19.620234+0000","last_undegraded":"2024-04-25T10:35:19.620234+0000","last_fullsized":"2024-04-25T10:35:19.620234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620303+0000","last_change":"2024-04-25T10:33:43.183091+0000","last_active":"2024-04-25T10:35:19.620303+0000","last_peered":"2024-04-25T10:35:19.620303+0000","last_clean":"2024-04-25T10:35:19.620303+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:35:19.620303+0000","last_undegraded":"2024-04-25T10:35:19.620303+0000","last_fullsized":"2024-04-25T10:35:19.620303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592323+0000","last_change":"2024-04-25T10:33:42.162393+0000","last_active":"2024-04-25T10:35:19.592323+0000","last_peered":"2024-04-25T10:35:19.592323+0000","last_clean":"2024-04-25T10:35:19.592323+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:35:19.592323+0000","last_undegraded":"2024-04-25T10:35:19.592323+0000","last_fullsized":"2024-04-25T10:35:19.592323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:57.969551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620466+0000","last_change":"2024-04-25T10:34:24.298321+0000","last_active":"2024-04-25T10:35:19.620466+0000","last_peered":"2024-04-25T10:35:19.620466+0000","last_clean":"2024-04-25T10:35:19.620466+0000","last_became_active":"2024-04-25T10:34:24.298059+0000","last_became_peered":"2024-04-25T10:34:24.298059+0000","last_unstale":"2024-04-25T10:35:19.620466+0000","last_undegraded":"2024-04-25T10:35:19.620466+0000","last_fullsized":"2024-04-25T10:35:19.620466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620569+0000","last_change":"2024-04-25T10:33:42.159468+0000","last_active":"2024-04-25T10:35:19.620569+0000","last_peered":"2024-04-25T10:35:19.620569+0000","last_clean":"2024-04-25T10:35:19.620569+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:35:19.620569+0000","last_undegraded":"2024-04-25T10:35:19.620569+0000","last_fullsized":"2024-04-25T10:35:19.620569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620855+0000","last_change":"2024-04-25T10:33:43.181841+0000","last_active":"2024-04-25T10:35:19.620855+0000","last_peered":"2024-04-25T10:35:19.620855+0000","last_clean":"2024-04-25T10:35:19.620855+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:35:19.620855+0000","last_undegraded":"2024-04-25T10:35:19.620855+0000","last_fullsized":"2024-04-25T10:35:19.620855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:37.937673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590270+0000","last_change":"2024-04-25T10:33:42.152094+0000","last_active":"2024-04-25T10:35:19.590270+0000","last_peered":"2024-04-25T10:35:19.590270+0000","last_clean":"2024-04-25T10:35:19.590270+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:35:19.590270+0000","last_undegraded":"2024-04-25T10:35:19.590270+0000","last_fullsized":"2024-04-25T10:35:19.590270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.924435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620343+0000","last_change":"2024-04-25T10:34:24.299747+0000","last_active":"2024-04-25T10:35:19.620343+0000","last_peered":"2024-04-25T10:35:19.620343+0000","last_clean":"2024-04-25T10:35:19.620343+0000","last_became_active":"2024-04-25T10:34:24.299411+0000","last_became_peered":"2024-04-25T10:34:24.299411+0000","last_unstale":"2024-04-25T10:35:19.620343+0000","last_undegraded":"2024-04-25T10:35:19.620343+0000","last_fullsized":"2024-04-25T10:35:19.620343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620411+0000","last_change":"2024-04-25T10:33:42.167140+0000","last_active":"2024-04-25T10:35:19.620411+0000","last_peered":"2024-04-25T10:35:19.620411+0000","last_clean":"2024-04-25T10:35:19.620411+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:35:19.620411+0000","last_undegraded":"2024-04-25T10:35:19.620411+0000","last_fullsized":"2024-04-25T10:35:19.620411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620535+0000","last_change":"2024-04-25T10:33:43.184750+0000","last_active":"2024-04-25T10:35:19.620535+0000","last_peered":"2024-04-25T10:35:19.620535+0000","last_clean":"2024-04-25T10:35:19.620535+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:35:19.620535+0000","last_undegraded":"2024-04-25T10:35:19.620535+0000","last_fullsized":"2024-04-25T10:35:19.620535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620399+0000","last_change":"2024-04-25T10:33:31.708843+0000","last_active":"2024-04-25T10:35:19.620399+0000","last_peered":"2024-04-25T10:35:19.620399+0000","last_clean":"2024-04-25T10:35:19.620399+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:35:19.620399+0000","last_undegraded":"2024-04-25T10:35:19.620399+0000","last_fullsized":"2024-04-25T10:35:19.620399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_clean_scrub_stamp":"2024-04-25T10:33:30.626866+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:10.475782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591077+0000","last_change":"2024-04-25T10:33:42.164505+0000","last_active":"2024-04-25T10:35:19.591077+0000","last_peered":"2024-04-25T10:35:19.591077+0000","last_clean":"2024-04-25T10:35:19.591077+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:35:19.591077+0000","last_undegraded":"2024-04-25T10:35:19.591077+0000","last_fullsized":"2024-04-25T10:35:19.591077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599426+0000","last_change":"2024-04-25T10:33:43.169958+0000","last_active":"2024-04-25T10:35:19.599426+0000","last_peered":"2024-04-25T10:35:19.599426+0000","last_clean":"2024-04-25T10:35:19.599426+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:35:19.599426+0000","last_undegraded":"2024-04-25T10:35:19.599426+0000","last_fullsized":"2024-04-25T10:35:19.599426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620280+0000","last_change":"2024-04-25T10:33:42.163852+0000","last_active":"2024-04-25T10:35:19.620280+0000","last_peered":"2024-04-25T10:35:19.620280+0000","last_clean":"2024-04-25T10:35:19.620280+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:35:19.620280+0000","last_undegraded":"2024-04-25T10:35:19.620280+0000","last_fullsized":"2024-04-25T10:35:19.620280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:28.602376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619188+0000","last_change":"2024-04-25T10:33:43.165039+0000","last_active":"2024-04-25T10:35:19.619188+0000","last_peered":"2024-04-25T10:35:19.619188+0000","last_clean":"2024-04-25T10:35:19.619188+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:35:19.619188+0000","last_undegraded":"2024-04-25T10:35:19.619188+0000","last_fullsized":"2024-04-25T10:35:19.619188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:30.822807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620386+0000","last_change":"2024-04-25T10:33:42.160012+0000","last_active":"2024-04-25T10:35:19.620386+0000","last_peered":"2024-04-25T10:35:19.620386+0000","last_clean":"2024-04-25T10:35:19.620386+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:35:19.620386+0000","last_undegraded":"2024-04-25T10:35:19.620386+0000","last_fullsized":"2024-04-25T10:35:19.620386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590040+0000","last_change":"2024-04-25T10:33:43.170473+0000","last_active":"2024-04-25T10:35:19.590040+0000","last_peered":"2024-04-25T10:35:19.590040+0000","last_clean":"2024-04-25T10:35:19.590040+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:35:19.590040+0000","last_undegraded":"2024-04-25T10:35:19.590040+0000","last_fullsized":"2024-04-25T10:35:19.590040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591243+0000","last_change":"2024-04-25T10:33:42.161197+0000","last_active":"2024-04-25T10:35:19.591243+0000","last_peered":"2024-04-25T10:35:19.591243+0000","last_clean":"2024-04-25T10:35:19.591243+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:35:19.591243+0000","last_undegraded":"2024-04-25T10:35:19.591243+0000","last_fullsized":"2024-04-25T10:35:19.591243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592261+0000","last_change":"2024-04-25T10:33:43.172447+0000","last_active":"2024-04-25T10:35:19.592261+0000","last_peered":"2024-04-25T10:35:19.592261+0000","last_clean":"2024-04-25T10:35:19.592261+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:35:19.592261+0000","last_undegraded":"2024-04-25T10:35:19.592261+0000","last_fullsized":"2024-04-25T10:35:19.592261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:19.195134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590171+0000","last_change":"2024-04-25T10:33:42.161100+0000","last_active":"2024-04-25T10:35:19.590171+0000","last_peered":"2024-04-25T10:35:19.590171+0000","last_clean":"2024-04-25T10:35:19.590171+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:35:19.590171+0000","last_undegraded":"2024-04-25T10:35:19.590171+0000","last_fullsized":"2024-04-25T10:35:19.590171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591604+0000","last_change":"2024-04-25T10:33:43.175361+0000","last_active":"2024-04-25T10:35:19.591604+0000","last_peered":"2024-04-25T10:35:19.591604+0000","last_clean":"2024-04-25T10:35:19.591604+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:35:19.591604+0000","last_undegraded":"2024-04-25T10:35:19.591604+0000","last_fullsized":"2024-04-25T10:35:19.591604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620761+0000","last_change":"2024-04-25T10:33:42.170292+0000","last_active":"2024-04-25T10:35:19.620761+0000","last_peered":"2024-04-25T10:35:19.620761+0000","last_clean":"2024-04-25T10:35:19.620761+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:35:19.620761+0000","last_undegraded":"2024-04-25T10:35:19.620761+0000","last_fullsized":"2024-04-25T10:35:19.620761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:47.392698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590121+0000","last_change":"2024-04-25T10:33:43.170285+0000","last_active":"2024-04-25T10:35:19.590121+0000","last_peered":"2024-04-25T10:35:19.590121+0000","last_clean":"2024-04-25T10:35:19.590121+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:35:19.590121+0000","last_undegraded":"2024-04-25T10:35:19.590121+0000","last_fullsized":"2024-04-25T10:35:19.590121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590454+0000","last_change":"2024-04-25T10:33:42.160069+0000","last_active":"2024-04-25T10:35:19.590454+0000","last_peered":"2024-04-25T10:35:19.590454+0000","last_clean":"2024-04-25T10:35:19.590454+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:35:19.590454+0000","last_undegraded":"2024-04-25T10:35:19.590454+0000","last_fullsized":"2024-04-25T10:35:19.590454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599709+0000","last_change":"2024-04-25T10:33:43.181641+0000","last_active":"2024-04-25T10:35:19.599709+0000","last_peered":"2024-04-25T10:35:19.599709+0000","last_clean":"2024-04-25T10:35:19.599709+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:35:19.599709+0000","last_undegraded":"2024-04-25T10:35:19.599709+0000","last_fullsized":"2024-04-25T10:35:19.599709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594344+0000","last_change":"2024-04-25T10:33:42.165706+0000","last_active":"2024-04-25T10:35:19.594344+0000","last_peered":"2024-04-25T10:35:19.594344+0000","last_clean":"2024-04-25T10:35:19.594344+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:35:19.594344+0000","last_undegraded":"2024-04-25T10:35:19.594344+0000","last_fullsized":"2024-04-25T10:35:19.594344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619615+0000","last_change":"2024-04-25T10:33:43.173260+0000","last_active":"2024-04-25T10:35:19.619615+0000","last_peered":"2024-04-25T10:35:19.619615+0000","last_clean":"2024-04-25T10:35:19.619615+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:35:19.619615+0000","last_undegraded":"2024-04-25T10:35:19.619615+0000","last_fullsized":"2024-04-25T10:35:19.619615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620263+0000","last_change":"2024-04-25T10:33:42.166946+0000","last_active":"2024-04-25T10:35:19.620263+0000","last_peered":"2024-04-25T10:35:19.620263+0000","last_clean":"2024-04-25T10:35:19.620263+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:35:19.620263+0000","last_undegraded":"2024-04-25T10:35:19.620263+0000","last_fullsized":"2024-04-25T10:35:19.620263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:29.817932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592050+0000","last_change":"2024-04-25T10:33:43.170510+0000","last_active":"2024-04-25T10:35:19.592050+0000","last_peered":"2024-04-25T10:35:19.592050+0000","last_clean":"2024-04-25T10:35:19.592050+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:35:19.592050+0000","last_undegraded":"2024-04-25T10:35:19.592050+0000","last_fullsized":"2024-04-25T10:35:19.592050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590156+0000","last_change":"2024-04-25T10:33:42.165204+0000","last_active":"2024-04-25T10:35:19.590156+0000","last_peered":"2024-04-25T10:35:19.590156+0000","last_clean":"2024-04-25T10:35:19.590156+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:35:19.590156+0000","last_undegraded":"2024-04-25T10:35:19.590156+0000","last_fullsized":"2024-04-25T10:35:19.590156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599436+0000","last_change":"2024-04-25T10:33:43.168088+0000","last_active":"2024-04-25T10:35:19.599436+0000","last_peered":"2024-04-25T10:35:19.599436+0000","last_clean":"2024-04-25T10:35:19.599436+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:35:19.599436+0000","last_undegraded":"2024-04-25T10:35:19.599436+0000","last_fullsized":"2024-04-25T10:35:19.599436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590347+0000","last_change":"2024-04-25T10:33:42.156381+0000","last_active":"2024-04-25T10:35:19.590347+0000","last_peered":"2024-04-25T10:35:19.590347+0000","last_clean":"2024-04-25T10:35:19.590347+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:35:19.590347+0000","last_undegraded":"2024-04-25T10:35:19.590347+0000","last_fullsized":"2024-04-25T10:35:19.590347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599508+0000","last_change":"2024-04-25T10:33:43.167502+0000","last_active":"2024-04-25T10:35:19.599508+0000","last_peered":"2024-04-25T10:35:19.599508+0000","last_clean":"2024-04-25T10:35:19.599508+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:35:19.599508+0000","last_undegraded":"2024-04-25T10:35:19.599508+0000","last_fullsized":"2024-04-25T10:35:19.599508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620596+0000","last_change":"2024-04-25T10:33:42.168840+0000","last_active":"2024-04-25T10:35:19.620596+0000","last_peered":"2024-04-25T10:35:19.620596+0000","last_clean":"2024-04-25T10:35:19.620596+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:35:19.620596+0000","last_undegraded":"2024-04-25T10:35:19.620596+0000","last_fullsized":"2024-04-25T10:35:19.620596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:51.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593984+0000","last_change":"2024-04-25T10:33:43.174672+0000","last_active":"2024-04-25T10:35:19.593984+0000","last_peered":"2024-04-25T10:35:19.593984+0000","last_clean":"2024-04-25T10:35:19.593984+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:35:19.593984+0000","last_undegraded":"2024-04-25T10:35:19.593984+0000","last_fullsized":"2024-04-25T10:35:19.593984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591576+0000","last_change":"2024-04-25T10:33:43.179274+0000","last_active":"2024-04-25T10:35:19.591576+0000","last_peered":"2024-04-25T10:35:19.591576+0000","last_clean":"2024-04-25T10:35:19.591576+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:35:19.591576+0000","last_undegraded":"2024-04-25T10:35:19.591576+0000","last_fullsized":"2024-04-25T10:35:19.591576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:24.341521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620487+0000","last_change":"2024-04-25T10:33:42.168654+0000","last_active":"2024-04-25T10:35:19.620487+0000","last_peered":"2024-04-25T10:35:19.620487+0000","last_clean":"2024-04-25T10:35:19.620487+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:35:19.620487+0000","last_undegraded":"2024-04-25T10:35:19.620487+0000","last_fullsized":"2024-04-25T10:35:19.620487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:15.158541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591205+0000","last_change":"2024-04-25T10:33:43.170923+0000","last_active":"2024-04-25T10:35:19.591205+0000","last_peered":"2024-04-25T10:35:19.591205+0000","last_clean":"2024-04-25T10:35:19.591205+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:35:19.591205+0000","last_undegraded":"2024-04-25T10:35:19.591205+0000","last_fullsized":"2024-04-25T10:35:19.591205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620653+0000","last_change":"2024-04-25T10:33:42.171374+0000","last_active":"2024-04-25T10:35:19.620653+0000","last_peered":"2024-04-25T10:35:19.620653+0000","last_clean":"2024-04-25T10:35:19.620653+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:35:19.620653+0000","last_undegraded":"2024-04-25T10:35:19.620653+0000","last_fullsized":"2024-04-25T10:35:19.620653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:41.709015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619407+0000","last_change":"2024-04-25T10:33:43.172788+0000","last_active":"2024-04-25T10:35:19.619407+0000","last_peered":"2024-04-25T10:35:19.619407+0000","last_clean":"2024-04-25T10:35:19.619407+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:35:19.619407+0000","last_undegraded":"2024-04-25T10:35:19.619407+0000","last_fullsized":"2024-04-25T10:35:19.619407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599727+0000","last_change":"2024-04-25T10:33:42.161364+0000","last_active":"2024-04-25T10:35:19.599727+0000","last_peered":"2024-04-25T10:35:19.599727+0000","last_clean":"2024-04-25T10:35:19.599727+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:35:19.599727+0000","last_undegraded":"2024-04-25T10:35:19.599727+0000","last_fullsized":"2024-04-25T10:35:19.599727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599690+0000","last_change":"2024-04-25T10:33:43.177654+0000","last_active":"2024-04-25T10:35:19.599690+0000","last_peered":"2024-04-25T10:35:19.599690+0000","last_clean":"2024-04-25T10:35:19.599690+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:35:19.599690+0000","last_undegraded":"2024-04-25T10:35:19.599690+0000","last_fullsized":"2024-04-25T10:35:19.599690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619679+0000","last_change":"2024-04-25T10:33:42.167156+0000","last_active":"2024-04-25T10:35:19.619679+0000","last_peered":"2024-04-25T10:35:19.619679+0000","last_clean":"2024-04-25T10:35:19.619679+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:35:19.619679+0000","last_undegraded":"2024-04-25T10:35:19.619679+0000","last_fullsized":"2024-04-25T10:35:19.619679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68881,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":109,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":137762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":680177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":156603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":89317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":89353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":157310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":89387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":680233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:35:25.434 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T10:35:25.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:35:25.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.577+0000 7fdb92be3640 1 Processor -- start 2024-04-25T10:35:25.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.577+0000 7fdb92be3640 1 -- start start 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.578+0000 7fdb92be3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c0b1df0 0x7fdb8c0b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.578+0000 7fdb92be3640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c0b2a80 con 0x7fdb8c0720e0 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.578+0000 7fdb92be3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c071bc0 con 0x7fdb8c0b84e0 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.578+0000 7fdb92be3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8c071970 con 0x7fdb8c0b1df0 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.578+0000 7fdb9097f640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdb8c0720e0 0x7fdb8c1472a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48260/0 (socket says 172.21.15.103:48260) 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.578+0000 7fdb9097f640 1 -- 172.21.15.103:0/3951348943 learned_addr learned my addr 172.21.15.103:0/3951348943 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635372674 0 0) 0x7fdb8c0b2a80 con 0x7fdb8c0720e0 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8bfff640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c0b1df0 0x7fdb8c0b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb7c003520 con 0x7fdb8c0720e0 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1867649519 0 0) 0x7fdb7c003520 con 0x7fdb8c0720e0 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c0b1df0 msgr2=0x7fdb8c0b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c0b1df0 0x7fdb8c0b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 >> v1:172.21.15.132:6789/0 conn(0x7fdb8c0b84e0 legacy=0x7fdb8c0b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c0b66b0 con 0x7fdb8c0720e0 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fdb80001670 con 0x7fdb8c0720e0 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 >> v1:172.21.15.103:6789/0 conn(0x7fdb8c0720e0 legacy=0x7fdb8c1472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c0b1df0 0x7fdb7c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c003f60 0x7fdb7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7c004d40 0x7fdb7c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c071970 con 0x7fdb7c004d40 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c00bc00 con 0x7fdb7c003f60 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7c00be00 con 0x7fdb8c0b1df0 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb91180640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7c004d40 0x7fdb7c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb9097f640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c0b1df0 0x7fdb7c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb8bfff640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c003f60 0x7fdb7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb91180640 1 -- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c0b1df0 msgr2=0x7fdb7c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb91180640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c0b1df0 0x7fdb7c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb91180640 1 -- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c003f60 msgr2=0x7fdb7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb91180640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c003f60 0x7fdb7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.579+0000 7fdb91180640 1 -- 172.21.15.103:0/3951348943 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c003520 con 0x7fdb7c004d40 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.580+0000 7fdb91180640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7c004d40 0x7fdb7c005150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb84001e20 tx=0x7fdb7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3b9fff2a1e7da5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.580+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84001a70 con 0x7fdb7c004d40 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.580+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8402ae40 con 0x7fdb7c004d40 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.580+0000 7fdb8b7fe640 1 -- 172.21.15.103:0/3951348943 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84003bb0 con 0x7fdb7c004d40 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.581+0000 7fdb92be3640 1 -- 172.21.15.103:0/3951348943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7c004d40 msgr2=0x7fdb7c005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.581+0000 7fdb92be3640 1 --2- 172.21.15.103:0/3951348943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb7c004d40 0x7fdb7c005150 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdb84001e20 tx=0x7fdb7c005830 comp rx=0 tx=0).stop 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.581+0000 7fdb91180640 1 -- 172.21.15.103:0/3951348943 reap_dead start 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.581+0000 7fdb92be3640 1 -- 172.21.15.103:0/3951348943 shutdown_connections 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.581+0000 7fdb92be3640 1 -- 172.21.15.103:0/3951348943 >> 172.21.15.103:0/3951348943 conn(0x7fdb8c0b93f0 msgr2=0x7fdb8c0b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.581+0000 7fdb92be3640 1 -- 172.21.15.103:0/3951348943 shutdown_connections 2024-04-25T10:35:25.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.581+0000 7fdb92be3640 1 -- 172.21.15.103:0/3951348943 wait complete. 2024-04-25T10:35:25.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.582+0000 7fdb92be3640 1 Processor -- start 2024-04-25T10:35:25.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.582+0000 7fdb92be3640 1 -- start start 2024-04-25T10:35:25.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.583+0000 7fdb92be3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c004d40 0x7fdb8c148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.583+0000 7fdb92be3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb8c148dd0 0x7fdb8c1d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.583+0000 7fdb92be3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c1d3120 0x7fdb8c13e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.583+0000 7fdb92be3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0b2530 con 0x7fdb8c148dd0 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.583+0000 7fdb92be3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0b23b0 con 0x7fdb7c004d40 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.583+0000 7fdb92be3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8c0b26b0 con 0x7fdb8c1d3120 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb8c148dd0 0x7fdb8c1d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb8c148dd0 0x7fdb8c1d2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50702/0 (socket says 172.21.15.103:50702) 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 -- 172.21.15.103:0/2342547815 learned_addr learned my addr 172.21.15.103:0/2342547815 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb91180640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c1d3120 0x7fdb8c13e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb9097f640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c004d40 0x7fdb8c148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 -- 172.21.15.103:0/2342547815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c1d3120 msgr2=0x7fdb8c13e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c1d3120 0x7fdb8c13e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 -- 172.21.15.103:0/2342547815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c004d40 msgr2=0x7fdb8c148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c004d40 0x7fdb8c148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 -- 172.21.15.103:0/2342547815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c13f870 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb8bfff640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb8c148dd0 0x7fdb8c1d2be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdb780119d0 tx=0x7fdb78011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb897fa640 1 -- 172.21.15.103:0/2342547815 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800fb50 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb897fa640 1 -- 172.21.15.103:0/2342547815 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7800fcf0 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c148400 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb897fa640 1 -- 172.21.15.103:0/2342547815 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800fea0 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.584+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8c1e0af0 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.585+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb8c06a130 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.586+0000 7fdb897fa640 1 -- 172.21.15.103:0/2342547815 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fdb78012040 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.586+0000 7fdb897fa640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdb700744b0 0x7fdb700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.587+0000 7fdb9097f640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdb700744b0 0x7fdb700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.587+0000 7fdb897fa640 1 -- 172.21.15.103:0/2342547815 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fdb780959c0 con 0x7fdb8c148dd0 2024-04-25T10:35:25.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.587+0000 7fdb9097f640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdb700744b0 0x7fdb700769c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb80007cb0 tx=0x7fdb80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.591+0000 7fdb897fa640 1 -- 172.21.15.103:0/2342547815 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdb78097e20 con 0x7fdb8c148dd0 2024-04-25T10:35:25.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.766+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb8c13ca60 con 0x7fdb700744b0 2024-04-25T10:35:25.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.772+0000 7fdb897fa640 1 -- 172.21.15.103:0/2342547815 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251861 (secure 0 0 0) 0x7fdb8c13ca60 con 0x7fdb700744b0 2024-04-25T10:35:25.776 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:35:25.777 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:35:25.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdb700744b0 msgr2=0x7fdb700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdb700744b0 0x7fdb700769c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb80007cb0 tx=0x7fdb80009040 comp rx=0 tx=0).stop 2024-04-25T10:35:25.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb8c148dd0 msgr2=0x7fdb8c1d2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb8c148dd0 0x7fdb8c1d2be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdb780119d0 tx=0x7fdb78011e90 comp rx=0 tx=0).stop 2024-04-25T10:35:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 shutdown_connections 2024-04-25T10:35:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fdb700744b0 0x7fdb700769c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdb8c1d3120 0x7fdb8c13e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb8c148dd0 0x7fdb8c1d2be0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 --2- 172.21.15.103:0/2342547815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb7c004d40 0x7fdb8c148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 >> 172.21.15.103:0/2342547815 conn(0x7fdb8c0b93f0 msgr2=0x7fdb8c140290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 shutdown_connections 2024-04-25T10:35:25.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.775+0000 7fdb92be3640 1 -- 172.21.15.103:0/2342547815 wait complete. 2024-04-25T10:35:25.788 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-25T10:35:24.515380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659249,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":218,"num_write_kb":1748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219396,"kb_used_data":3236,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755324,"statfs":{"total":773094113280,"available":772869451776,"internally_reserved":0,"allocated":3313664,"data_stored":2026203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":66471,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":72,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002178"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620741+0000","last_change":"2024-04-25T10:33:43.181183+0000","last_active":"2024-04-25T10:35:19.620741+0000","last_peered":"2024-04-25T10:35:19.620741+0000","last_clean":"2024-04-25T10:35:19.620741+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:35:19.620741+0000","last_undegraded":"2024-04-25T10:35:19.620741+0000","last_fullsized":"2024-04-25T10:35:19.620741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:44.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590380+0000","last_change":"2024-04-25T10:33:43.170436+0000","last_active":"2024-04-25T10:35:19.590380+0000","last_peered":"2024-04-25T10:35:19.590380+0000","last_clean":"2024-04-25T10:35:19.590380+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:35:19.590380+0000","last_undegraded":"2024-04-25T10:35:19.590380+0000","last_fullsized":"2024-04-25T10:35:19.590380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619458+0000","last_change":"2024-04-25T10:33:43.181271+0000","last_active":"2024-04-25T10:35:19.619458+0000","last_peered":"2024-04-25T10:35:19.619458+0000","last_clean":"2024-04-25T10:35:19.619458+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:35:19.619458+0000","last_undegraded":"2024-04-25T10:35:19.619458+0000","last_fullsized":"2024-04-25T10:35:19.619458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591102+0000","last_change":"2024-04-25T10:33:43.176831+0000","last_active":"2024-04-25T10:35:19.591102+0000","last_peered":"2024-04-25T10:35:19.591102+0000","last_clean":"2024-04-25T10:35:19.591102+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:35:19.591102+0000","last_undegraded":"2024-04-25T10:35:19.591102+0000","last_fullsized":"2024-04-25T10:35:19.591102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620456+0000","last_change":"2024-04-25T10:33:43.181222+0000","last_active":"2024-04-25T10:35:19.620456+0000","last_peered":"2024-04-25T10:35:19.620456+0000","last_clean":"2024-04-25T10:35:19.620456+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:35:19.620456+0000","last_undegraded":"2024-04-25T10:35:19.620456+0000","last_fullsized":"2024-04-25T10:35:19.620456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:42.544249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590996+0000","last_change":"2024-04-25T10:33:43.175444+0000","last_active":"2024-04-25T10:35:19.590996+0000","last_peered":"2024-04-25T10:35:19.590996+0000","last_clean":"2024-04-25T10:35:19.590996+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:35:19.590996+0000","last_undegraded":"2024-04-25T10:35:19.590996+0000","last_fullsized":"2024-04-25T10:35:19.590996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620299+0000","last_change":"2024-04-25T10:33:43.186303+0000","last_active":"2024-04-25T10:35:19.620299+0000","last_peered":"2024-04-25T10:35:19.620299+0000","last_clean":"2024-04-25T10:35:19.620299+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:35:19.620299+0000","last_undegraded":"2024-04-25T10:35:19.620299+0000","last_fullsized":"2024-04-25T10:35:19.620299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599277+0000","last_change":"2024-04-25T10:33:43.169919+0000","last_active":"2024-04-25T10:35:19.599277+0000","last_peered":"2024-04-25T10:35:19.599277+0000","last_clean":"2024-04-25T10:35:19.599277+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:35:19.599277+0000","last_undegraded":"2024-04-25T10:35:19.599277+0000","last_fullsized":"2024-04-25T10:35:19.599277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620817+0000","last_change":"2024-04-25T10:34:24.321277+0000","last_active":"2024-04-25T10:35:19.620817+0000","last_peered":"2024-04-25T10:35:19.620817+0000","last_clean":"2024-04-25T10:35:19.620817+0000","last_became_active":"2024-04-25T10:34:24.320939+0000","last_became_peered":"2024-04-25T10:34:24.320939+0000","last_unstale":"2024-04-25T10:35:19.620817+0000","last_undegraded":"2024-04-25T10:35:19.620817+0000","last_fullsized":"2024-04-25T10:35:19.620817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:35.139675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594280+0000","last_change":"2024-04-25T10:33:43.175552+0000","last_active":"2024-04-25T10:35:19.594280+0000","last_peered":"2024-04-25T10:35:19.594280+0000","last_clean":"2024-04-25T10:35:19.594280+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:35:19.594280+0000","last_undegraded":"2024-04-25T10:35:19.594280+0000","last_fullsized":"2024-04-25T10:35:19.594280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594215+0000","last_change":"2024-04-25T10:33:43.175526+0000","last_active":"2024-04-25T10:35:19.594215+0000","last_peered":"2024-04-25T10:35:19.594215+0000","last_clean":"2024-04-25T10:35:19.594215+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:35:19.594215+0000","last_undegraded":"2024-04-25T10:35:19.594215+0000","last_fullsized":"2024-04-25T10:35:19.594215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592368+0000","last_change":"2024-04-25T10:33:43.176506+0000","last_active":"2024-04-25T10:35:19.592368+0000","last_peered":"2024-04-25T10:35:19.592368+0000","last_clean":"2024-04-25T10:35:19.592368+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:35:19.592368+0000","last_undegraded":"2024-04-25T10:35:19.592368+0000","last_fullsized":"2024-04-25T10:35:19.592368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:54.213946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599412+0000","last_change":"2024-04-25T10:33:43.178091+0000","last_active":"2024-04-25T10:35:19.599412+0000","last_peered":"2024-04-25T10:35:19.599412+0000","last_clean":"2024-04-25T10:35:19.599412+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:35:19.599412+0000","last_undegraded":"2024-04-25T10:35:19.599412+0000","last_fullsized":"2024-04-25T10:35:19.599412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'2","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619231+0000","last_change":"2024-04-25T10:33:43.173440+0000","last_active":"2024-04-25T10:35:19.619231+0000","last_peered":"2024-04-25T10:35:19.619231+0000","last_clean":"2024-04-25T10:35:19.619231+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:35:19.619231+0000","last_undegraded":"2024-04-25T10:35:19.619231+0000","last_fullsized":"2024-04-25T10:35:19.619231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.607252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590008+0000","last_change":"2024-04-25T10:33:43.172566+0000","last_active":"2024-04-25T10:35:19.590008+0000","last_peered":"2024-04-25T10:35:19.590008+0000","last_clean":"2024-04-25T10:35:19.590008+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:35:19.590008+0000","last_undegraded":"2024-04-25T10:35:19.590008+0000","last_fullsized":"2024-04-25T10:35:19.590008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590878+0000","last_change":"2024-04-25T10:33:43.175162+0000","last_active":"2024-04-25T10:35:19.590878+0000","last_peered":"2024-04-25T10:35:19.590878+0000","last_clean":"2024-04-25T10:35:19.590878+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:35:19.590878+0000","last_undegraded":"2024-04-25T10:35:19.590878+0000","last_fullsized":"2024-04-25T10:35:19.590878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591309+0000","last_change":"2024-04-25T10:33:43.183071+0000","last_active":"2024-04-25T10:35:19.591309+0000","last_peered":"2024-04-25T10:35:19.591309+0000","last_clean":"2024-04-25T10:35:19.591309+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:35:19.591309+0000","last_undegraded":"2024-04-25T10:35:19.591309+0000","last_fullsized":"2024-04-25T10:35:19.591309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620468+0000","last_change":"2024-04-25T10:33:43.179022+0000","last_active":"2024-04-25T10:35:19.620468+0000","last_peered":"2024-04-25T10:35:19.620468+0000","last_clean":"2024-04-25T10:35:19.620468+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:35:19.620468+0000","last_undegraded":"2024-04-25T10:35:19.620468+0000","last_fullsized":"2024-04-25T10:35:19.620468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620727+0000","last_change":"2024-04-25T10:33:43.186661+0000","last_active":"2024-04-25T10:35:19.620727+0000","last_peered":"2024-04-25T10:35:19.620727+0000","last_clean":"2024-04-25T10:35:19.620727+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:35:19.620727+0000","last_undegraded":"2024-04-25T10:35:19.620727+0000","last_fullsized":"2024-04-25T10:35:19.620727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.758005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594145+0000","last_change":"2024-04-25T10:33:43.175801+0000","last_active":"2024-04-25T10:35:19.594145+0000","last_peered":"2024-04-25T10:35:19.594145+0000","last_clean":"2024-04-25T10:35:19.594145+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:35:19.594145+0000","last_undegraded":"2024-04-25T10:35:19.594145+0000","last_fullsized":"2024-04-25T10:35:19.594145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619437+0000","last_change":"2024-04-25T10:33:43.183056+0000","last_active":"2024-04-25T10:35:19.619437+0000","last_peered":"2024-04-25T10:35:19.619437+0000","last_clean":"2024-04-25T10:35:19.619437+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:35:19.619437+0000","last_undegraded":"2024-04-25T10:35:19.619437+0000","last_fullsized":"2024-04-25T10:35:19.619437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591030+0000","last_change":"2024-04-25T10:33:43.180388+0000","last_active":"2024-04-25T10:35:19.591030+0000","last_peered":"2024-04-25T10:35:19.591030+0000","last_clean":"2024-04-25T10:35:19.591030+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:35:19.591030+0000","last_undegraded":"2024-04-25T10:35:19.591030+0000","last_fullsized":"2024-04-25T10:35:19.591030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599358+0000","last_change":"2024-04-25T10:33:43.162216+0000","last_active":"2024-04-25T10:35:19.599358+0000","last_peered":"2024-04-25T10:35:19.599358+0000","last_clean":"2024-04-25T10:35:19.599358+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:35:19.599358+0000","last_undegraded":"2024-04-25T10:35:19.599358+0000","last_fullsized":"2024-04-25T10:35:19.599358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590950+0000","last_change":"2024-04-25T10:33:43.183734+0000","last_active":"2024-04-25T10:35:19.590950+0000","last_peered":"2024-04-25T10:35:19.590950+0000","last_clean":"2024-04-25T10:35:19.590950+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:35:19.590950+0000","last_undegraded":"2024-04-25T10:35:19.590950+0000","last_fullsized":"2024-04-25T10:35:19.590950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620538+0000","last_change":"2024-04-25T10:34:24.299795+0000","last_active":"2024-04-25T10:35:19.620538+0000","last_peered":"2024-04-25T10:35:19.620538+0000","last_clean":"2024-04-25T10:35:19.620538+0000","last_became_active":"2024-04-25T10:34:24.299359+0000","last_became_peered":"2024-04-25T10:34:24.299359+0000","last_unstale":"2024-04-25T10:35:19.620538+0000","last_undegraded":"2024-04-25T10:35:19.620538+0000","last_fullsized":"2024-04-25T10:35:19.620538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594381+0000","last_change":"2024-04-25T10:33:43.183648+0000","last_active":"2024-04-25T10:35:19.594381+0000","last_peered":"2024-04-25T10:35:19.594381+0000","last_clean":"2024-04-25T10:35:19.594381+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:35:19.594381+0000","last_undegraded":"2024-04-25T10:35:19.594381+0000","last_fullsized":"2024-04-25T10:35:19.594381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'2","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590117+0000","last_change":"2024-04-25T10:33:43.175229+0000","last_active":"2024-04-25T10:35:19.590117+0000","last_peered":"2024-04-25T10:35:19.590117+0000","last_clean":"2024-04-25T10:35:19.590117+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:35:19.590117+0000","last_undegraded":"2024-04-25T10:35:19.590117+0000","last_fullsized":"2024-04-25T10:35:19.590117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599703+0000","last_change":"2024-04-25T10:33:43.162579+0000","last_active":"2024-04-25T10:35:19.599703+0000","last_peered":"2024-04-25T10:35:19.599703+0000","last_clean":"2024-04-25T10:35:19.599703+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:35:19.599703+0000","last_undegraded":"2024-04-25T10:35:19.599703+0000","last_fullsized":"2024-04-25T10:35:19.599703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619415+0000","last_change":"2024-04-25T10:33:43.168576+0000","last_active":"2024-04-25T10:35:19.619415+0000","last_peered":"2024-04-25T10:35:19.619415+0000","last_clean":"2024-04-25T10:35:19.619415+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:35:19.619415+0000","last_undegraded":"2024-04-25T10:35:19.619415+0000","last_fullsized":"2024-04-25T10:35:19.619415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591110+0000","last_change":"2024-04-25T10:33:43.182970+0000","last_active":"2024-04-25T10:35:19.591110+0000","last_peered":"2024-04-25T10:35:19.591110+0000","last_clean":"2024-04-25T10:35:19.591110+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:35:19.591110+0000","last_undegraded":"2024-04-25T10:35:19.591110+0000","last_fullsized":"2024-04-25T10:35:19.591110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620250+0000","last_change":"2024-04-25T10:33:43.171456+0000","last_active":"2024-04-25T10:35:19.620250+0000","last_peered":"2024-04-25T10:35:19.620250+0000","last_clean":"2024-04-25T10:35:19.620250+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:35:19.620250+0000","last_undegraded":"2024-04-25T10:35:19.620250+0000","last_fullsized":"2024-04-25T10:35:19.620250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593943+0000","last_change":"2024-04-25T10:33:43.183419+0000","last_active":"2024-04-25T10:35:19.593943+0000","last_peered":"2024-04-25T10:35:19.593943+0000","last_clean":"2024-04-25T10:35:19.593943+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:35:19.593943+0000","last_undegraded":"2024-04-25T10:35:19.593943+0000","last_fullsized":"2024-04-25T10:35:19.593943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592007+0000","last_change":"2024-04-25T10:33:43.170134+0000","last_active":"2024-04-25T10:35:19.592007+0000","last_peered":"2024-04-25T10:35:19.592007+0000","last_clean":"2024-04-25T10:35:19.592007+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:35:19.592007+0000","last_undegraded":"2024-04-25T10:35:19.592007+0000","last_fullsized":"2024-04-25T10:35:19.592007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:06.463548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599586+0000","last_change":"2024-04-25T10:33:42.162138+0000","last_active":"2024-04-25T10:35:19.599586+0000","last_peered":"2024-04-25T10:35:19.599586+0000","last_clean":"2024-04-25T10:35:19.599586+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:35:19.599586+0000","last_undegraded":"2024-04-25T10:35:19.599586+0000","last_fullsized":"2024-04-25T10:35:19.599586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619546+0000","last_change":"2024-04-25T10:33:43.172141+0000","last_active":"2024-04-25T10:35:19.619546+0000","last_peered":"2024-04-25T10:35:19.619546+0000","last_clean":"2024-04-25T10:35:19.619546+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:35:19.619546+0000","last_undegraded":"2024-04-25T10:35:19.619546+0000","last_fullsized":"2024-04-25T10:35:19.619546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594071+0000","last_change":"2024-04-25T10:33:42.161614+0000","last_active":"2024-04-25T10:35:19.594071+0000","last_peered":"2024-04-25T10:35:19.594071+0000","last_clean":"2024-04-25T10:35:19.594071+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:35:19.594071+0000","last_undegraded":"2024-04-25T10:35:19.594071+0000","last_fullsized":"2024-04-25T10:35:19.594071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599385+0000","last_change":"2024-04-25T10:33:42.158934+0000","last_active":"2024-04-25T10:35:19.599385+0000","last_peered":"2024-04-25T10:35:19.599385+0000","last_clean":"2024-04-25T10:35:19.599385+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:35:19.599385+0000","last_undegraded":"2024-04-25T10:35:19.599385+0000","last_fullsized":"2024-04-25T10:35:19.599385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599345+0000","last_change":"2024-04-25T10:33:43.170270+0000","last_active":"2024-04-25T10:35:19.599345+0000","last_peered":"2024-04-25T10:35:19.599345+0000","last_clean":"2024-04-25T10:35:19.599345+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:35:19.599345+0000","last_undegraded":"2024-04-25T10:35:19.599345+0000","last_fullsized":"2024-04-25T10:35:19.599345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591039+0000","last_change":"2024-04-25T10:33:42.162167+0000","last_active":"2024-04-25T10:35:19.591039+0000","last_peered":"2024-04-25T10:35:19.591039+0000","last_clean":"2024-04-25T10:35:19.591039+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:35:19.591039+0000","last_undegraded":"2024-04-25T10:35:19.591039+0000","last_fullsized":"2024-04-25T10:35:19.591039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590003+0000","last_change":"2024-04-25T10:33:43.174366+0000","last_active":"2024-04-25T10:35:19.590003+0000","last_peered":"2024-04-25T10:35:19.590003+0000","last_clean":"2024-04-25T10:35:19.590003+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:35:19.590003+0000","last_undegraded":"2024-04-25T10:35:19.590003+0000","last_fullsized":"2024-04-25T10:35:19.590003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594335+0000","last_change":"2024-04-25T10:33:42.163161+0000","last_active":"2024-04-25T10:35:19.594335+0000","last_peered":"2024-04-25T10:35:19.594335+0000","last_clean":"2024-04-25T10:35:19.594335+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:35:19.594335+0000","last_undegraded":"2024-04-25T10:35:19.594335+0000","last_fullsized":"2024-04-25T10:35:19.594335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591501+0000","last_change":"2024-04-25T10:33:43.179159+0000","last_active":"2024-04-25T10:35:19.591501+0000","last_peered":"2024-04-25T10:35:19.591501+0000","last_clean":"2024-04-25T10:35:19.591501+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:35:19.591501+0000","last_undegraded":"2024-04-25T10:35:19.591501+0000","last_fullsized":"2024-04-25T10:35:19.591501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591501+0000","last_change":"2024-04-25T10:33:42.168608+0000","last_active":"2024-04-25T10:35:19.591501+0000","last_peered":"2024-04-25T10:35:19.591501+0000","last_clean":"2024-04-25T10:35:19.591501+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:35:19.591501+0000","last_undegraded":"2024-04-25T10:35:19.591501+0000","last_fullsized":"2024-04-25T10:35:19.591501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619569+0000","last_change":"2024-04-25T10:33:43.172553+0000","last_active":"2024-04-25T10:35:19.619569+0000","last_peered":"2024-04-25T10:35:19.619569+0000","last_clean":"2024-04-25T10:35:19.619569+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:35:19.619569+0000","last_undegraded":"2024-04-25T10:35:19.619569+0000","last_fullsized":"2024-04-25T10:35:19.619569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590175+0000","last_change":"2024-04-25T10:33:42.160656+0000","last_active":"2024-04-25T10:35:19.590175+0000","last_peered":"2024-04-25T10:35:19.590175+0000","last_clean":"2024-04-25T10:35:19.590175+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:35:19.590175+0000","last_undegraded":"2024-04-25T10:35:19.590175+0000","last_fullsized":"2024-04-25T10:35:19.590175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:16.669213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592361+0000","last_change":"2024-04-25T10:33:43.178426+0000","last_active":"2024-04-25T10:35:19.592361+0000","last_peered":"2024-04-25T10:35:19.592361+0000","last_clean":"2024-04-25T10:35:19.592361+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:35:19.592361+0000","last_undegraded":"2024-04-25T10:35:19.592361+0000","last_fullsized":"2024-04-25T10:35:19.592361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'64","reported_seq":84,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594223+0000","last_change":"2024-04-25T10:33:42.160251+0000","last_active":"2024-04-25T10:35:19.594223+0000","last_peered":"2024-04-25T10:35:19.594223+0000","last_clean":"2024-04-25T10:35:19.594223+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:35:19.594223+0000","last_undegraded":"2024-04-25T10:35:19.594223+0000","last_fullsized":"2024-04-25T10:35:19.594223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67376,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620528+0000","last_change":"2024-04-25T10:33:43.180666+0000","last_active":"2024-04-25T10:35:19.620528+0000","last_peered":"2024-04-25T10:35:19.620528+0000","last_clean":"2024-04-25T10:35:19.620528+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:35:19.620528+0000","last_undegraded":"2024-04-25T10:35:19.620528+0000","last_fullsized":"2024-04-25T10:35:19.620528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619569+0000","last_change":"2024-04-25T10:33:42.164005+0000","last_active":"2024-04-25T10:35:19.619569+0000","last_peered":"2024-04-25T10:35:19.619569+0000","last_clean":"2024-04-25T10:35:19.619569+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:35:19.619569+0000","last_undegraded":"2024-04-25T10:35:19.619569+0000","last_fullsized":"2024-04-25T10:35:19.619569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:54.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619404+0000","last_change":"2024-04-25T10:33:43.181483+0000","last_active":"2024-04-25T10:35:19.619404+0000","last_peered":"2024-04-25T10:35:19.619404+0000","last_clean":"2024-04-25T10:35:19.619404+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:35:19.619404+0000","last_undegraded":"2024-04-25T10:35:19.619404+0000","last_fullsized":"2024-04-25T10:35:19.619404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:42.713890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591150+0000","last_change":"2024-04-25T10:33:42.163146+0000","last_active":"2024-04-25T10:35:19.591150+0000","last_peered":"2024-04-25T10:35:19.591150+0000","last_clean":"2024-04-25T10:35:19.591150+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:35:19.591150+0000","last_undegraded":"2024-04-25T10:35:19.591150+0000","last_fullsized":"2024-04-25T10:35:19.591150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620467+0000","last_change":"2024-04-25T10:33:43.183314+0000","last_active":"2024-04-25T10:35:19.620467+0000","last_peered":"2024-04-25T10:35:19.620467+0000","last_clean":"2024-04-25T10:35:19.620467+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:35:19.620467+0000","last_undegraded":"2024-04-25T10:35:19.620467+0000","last_fullsized":"2024-04-25T10:35:19.620467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:07.841471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593969+0000","last_change":"2024-04-25T10:33:42.166542+0000","last_active":"2024-04-25T10:35:19.593969+0000","last_peered":"2024-04-25T10:35:19.593969+0000","last_clean":"2024-04-25T10:35:19.593969+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:35:19.593969+0000","last_undegraded":"2024-04-25T10:35:19.593969+0000","last_fullsized":"2024-04-25T10:35:19.593969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593951+0000","last_change":"2024-04-25T10:33:43.176217+0000","last_active":"2024-04-25T10:35:19.593951+0000","last_peered":"2024-04-25T10:35:19.593951+0000","last_clean":"2024-04-25T10:35:19.593951+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:35:19.593951+0000","last_undegraded":"2024-04-25T10:35:19.593951+0000","last_fullsized":"2024-04-25T10:35:19.593951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620234+0000","last_change":"2024-04-25T10:33:42.156163+0000","last_active":"2024-04-25T10:35:19.620234+0000","last_peered":"2024-04-25T10:35:19.620234+0000","last_clean":"2024-04-25T10:35:19.620234+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:35:19.620234+0000","last_undegraded":"2024-04-25T10:35:19.620234+0000","last_fullsized":"2024-04-25T10:35:19.620234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620303+0000","last_change":"2024-04-25T10:33:43.183091+0000","last_active":"2024-04-25T10:35:19.620303+0000","last_peered":"2024-04-25T10:35:19.620303+0000","last_clean":"2024-04-25T10:35:19.620303+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:35:19.620303+0000","last_undegraded":"2024-04-25T10:35:19.620303+0000","last_fullsized":"2024-04-25T10:35:19.620303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592323+0000","last_change":"2024-04-25T10:33:42.162393+0000","last_active":"2024-04-25T10:35:19.592323+0000","last_peered":"2024-04-25T10:35:19.592323+0000","last_clean":"2024-04-25T10:35:19.592323+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:35:19.592323+0000","last_undegraded":"2024-04-25T10:35:19.592323+0000","last_fullsized":"2024-04-25T10:35:19.592323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:57.969551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620466+0000","last_change":"2024-04-25T10:34:24.298321+0000","last_active":"2024-04-25T10:35:19.620466+0000","last_peered":"2024-04-25T10:35:19.620466+0000","last_clean":"2024-04-25T10:35:19.620466+0000","last_became_active":"2024-04-25T10:34:24.298059+0000","last_became_peered":"2024-04-25T10:34:24.298059+0000","last_unstale":"2024-04-25T10:35:19.620466+0000","last_undegraded":"2024-04-25T10:35:19.620466+0000","last_fullsized":"2024-04-25T10:35:19.620466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620569+0000","last_change":"2024-04-25T10:33:42.159468+0000","last_active":"2024-04-25T10:35:19.620569+0000","last_peered":"2024-04-25T10:35:19.620569+0000","last_clean":"2024-04-25T10:35:19.620569+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:35:19.620569+0000","last_undegraded":"2024-04-25T10:35:19.620569+0000","last_fullsized":"2024-04-25T10:35:19.620569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620855+0000","last_change":"2024-04-25T10:33:43.181841+0000","last_active":"2024-04-25T10:35:19.620855+0000","last_peered":"2024-04-25T10:35:19.620855+0000","last_clean":"2024-04-25T10:35:19.620855+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:35:19.620855+0000","last_undegraded":"2024-04-25T10:35:19.620855+0000","last_fullsized":"2024-04-25T10:35:19.620855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:37.937673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590270+0000","last_change":"2024-04-25T10:33:42.152094+0000","last_active":"2024-04-25T10:35:19.590270+0000","last_peered":"2024-04-25T10:35:19.590270+0000","last_clean":"2024-04-25T10:35:19.590270+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:35:19.590270+0000","last_undegraded":"2024-04-25T10:35:19.590270+0000","last_fullsized":"2024-04-25T10:35:19.590270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.924435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620343+0000","last_change":"2024-04-25T10:34:24.299747+0000","last_active":"2024-04-25T10:35:19.620343+0000","last_peered":"2024-04-25T10:35:19.620343+0000","last_clean":"2024-04-25T10:35:19.620343+0000","last_became_active":"2024-04-25T10:34:24.299411+0000","last_became_peered":"2024-04-25T10:34:24.299411+0000","last_unstale":"2024-04-25T10:35:19.620343+0000","last_undegraded":"2024-04-25T10:35:19.620343+0000","last_fullsized":"2024-04-25T10:35:19.620343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620411+0000","last_change":"2024-04-25T10:33:42.167140+0000","last_active":"2024-04-25T10:35:19.620411+0000","last_peered":"2024-04-25T10:35:19.620411+0000","last_clean":"2024-04-25T10:35:19.620411+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:35:19.620411+0000","last_undegraded":"2024-04-25T10:35:19.620411+0000","last_fullsized":"2024-04-25T10:35:19.620411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620535+0000","last_change":"2024-04-25T10:33:43.184750+0000","last_active":"2024-04-25T10:35:19.620535+0000","last_peered":"2024-04-25T10:35:19.620535+0000","last_clean":"2024-04-25T10:35:19.620535+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:35:19.620535+0000","last_undegraded":"2024-04-25T10:35:19.620535+0000","last_fullsized":"2024-04-25T10:35:19.620535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620399+0000","last_change":"2024-04-25T10:33:31.708843+0000","last_active":"2024-04-25T10:35:19.620399+0000","last_peered":"2024-04-25T10:35:19.620399+0000","last_clean":"2024-04-25T10:35:19.620399+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:35:19.620399+0000","last_undegraded":"2024-04-25T10:35:19.620399+0000","last_fullsized":"2024-04-25T10:35:19.620399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_clean_scrub_stamp":"2024-04-25T10:33:30.626866+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:10.475782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591077+0000","last_change":"2024-04-25T10:33:42.164505+0000","last_active":"2024-04-25T10:35:19.591077+0000","last_peered":"2024-04-25T10:35:19.591077+0000","last_clean":"2024-04-25T10:35:19.591077+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:35:19.591077+0000","last_undegraded":"2024-04-25T10:35:19.591077+0000","last_fullsized":"2024-04-25T10:35:19.591077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599426+0000","last_change":"2024-04-25T10:33:43.169958+0000","last_active":"2024-04-25T10:35:19.599426+0000","last_peered":"2024-04-25T10:35:19.599426+0000","last_clean":"2024-04-25T10:35:19.599426+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:35:19.599426+0000","last_undegraded":"2024-04-25T10:35:19.599426+0000","last_fullsized":"2024-04-25T10:35:19.599426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620280+0000","last_change":"2024-04-25T10:33:42.163852+0000","last_active":"2024-04-25T10:35:19.620280+0000","last_peered":"2024-04-25T10:35:19.620280+0000","last_clean":"2024-04-25T10:35:19.620280+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:35:19.620280+0000","last_undegraded":"2024-04-25T10:35:19.620280+0000","last_fullsized":"2024-04-25T10:35:19.620280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:28.602376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619188+0000","last_change":"2024-04-25T10:33:43.165039+0000","last_active":"2024-04-25T10:35:19.619188+0000","last_peered":"2024-04-25T10:35:19.619188+0000","last_clean":"2024-04-25T10:35:19.619188+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:35:19.619188+0000","last_undegraded":"2024-04-25T10:35:19.619188+0000","last_fullsized":"2024-04-25T10:35:19.619188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:30.822807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'2","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620386+0000","last_change":"2024-04-25T10:33:42.160012+0000","last_active":"2024-04-25T10:35:19.620386+0000","last_peered":"2024-04-25T10:35:19.620386+0000","last_clean":"2024-04-25T10:35:19.620386+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:35:19.620386+0000","last_undegraded":"2024-04-25T10:35:19.620386+0000","last_fullsized":"2024-04-25T10:35:19.620386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590040+0000","last_change":"2024-04-25T10:33:43.170473+0000","last_active":"2024-04-25T10:35:19.590040+0000","last_peered":"2024-04-25T10:35:19.590040+0000","last_clean":"2024-04-25T10:35:19.590040+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:35:19.590040+0000","last_undegraded":"2024-04-25T10:35:19.590040+0000","last_fullsized":"2024-04-25T10:35:19.590040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591243+0000","last_change":"2024-04-25T10:33:42.161197+0000","last_active":"2024-04-25T10:35:19.591243+0000","last_peered":"2024-04-25T10:35:19.591243+0000","last_clean":"2024-04-25T10:35:19.591243+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:35:19.591243+0000","last_undegraded":"2024-04-25T10:35:19.591243+0000","last_fullsized":"2024-04-25T10:35:19.591243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592261+0000","last_change":"2024-04-25T10:33:43.172447+0000","last_active":"2024-04-25T10:35:19.592261+0000","last_peered":"2024-04-25T10:35:19.592261+0000","last_clean":"2024-04-25T10:35:19.592261+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:35:19.592261+0000","last_undegraded":"2024-04-25T10:35:19.592261+0000","last_fullsized":"2024-04-25T10:35:19.592261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:19.195134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590171+0000","last_change":"2024-04-25T10:33:42.161100+0000","last_active":"2024-04-25T10:35:19.590171+0000","last_peered":"2024-04-25T10:35:19.590171+0000","last_clean":"2024-04-25T10:35:19.590171+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:35:19.590171+0000","last_undegraded":"2024-04-25T10:35:19.590171+0000","last_fullsized":"2024-04-25T10:35:19.590171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591604+0000","last_change":"2024-04-25T10:33:43.175361+0000","last_active":"2024-04-25T10:35:19.591604+0000","last_peered":"2024-04-25T10:35:19.591604+0000","last_clean":"2024-04-25T10:35:19.591604+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:35:19.591604+0000","last_undegraded":"2024-04-25T10:35:19.591604+0000","last_fullsized":"2024-04-25T10:35:19.591604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620761+0000","last_change":"2024-04-25T10:33:42.170292+0000","last_active":"2024-04-25T10:35:19.620761+0000","last_peered":"2024-04-25T10:35:19.620761+0000","last_clean":"2024-04-25T10:35:19.620761+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:35:19.620761+0000","last_undegraded":"2024-04-25T10:35:19.620761+0000","last_fullsized":"2024-04-25T10:35:19.620761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:47.392698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590121+0000","last_change":"2024-04-25T10:33:43.170285+0000","last_active":"2024-04-25T10:35:19.590121+0000","last_peered":"2024-04-25T10:35:19.590121+0000","last_clean":"2024-04-25T10:35:19.590121+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:35:19.590121+0000","last_undegraded":"2024-04-25T10:35:19.590121+0000","last_fullsized":"2024-04-25T10:35:19.590121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590454+0000","last_change":"2024-04-25T10:33:42.160069+0000","last_active":"2024-04-25T10:35:19.590454+0000","last_peered":"2024-04-25T10:35:19.590454+0000","last_clean":"2024-04-25T10:35:19.590454+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:35:19.590454+0000","last_undegraded":"2024-04-25T10:35:19.590454+0000","last_fullsized":"2024-04-25T10:35:19.590454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'3","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599709+0000","last_change":"2024-04-25T10:33:43.181641+0000","last_active":"2024-04-25T10:35:19.599709+0000","last_peered":"2024-04-25T10:35:19.599709+0000","last_clean":"2024-04-25T10:35:19.599709+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:35:19.599709+0000","last_undegraded":"2024-04-25T10:35:19.599709+0000","last_fullsized":"2024-04-25T10:35:19.599709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594344+0000","last_change":"2024-04-25T10:33:42.165706+0000","last_active":"2024-04-25T10:35:19.594344+0000","last_peered":"2024-04-25T10:35:19.594344+0000","last_clean":"2024-04-25T10:35:19.594344+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:35:19.594344+0000","last_undegraded":"2024-04-25T10:35:19.594344+0000","last_fullsized":"2024-04-25T10:35:19.594344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619615+0000","last_change":"2024-04-25T10:33:43.173260+0000","last_active":"2024-04-25T10:35:19.619615+0000","last_peered":"2024-04-25T10:35:19.619615+0000","last_clean":"2024-04-25T10:35:19.619615+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:35:19.619615+0000","last_undegraded":"2024-04-25T10:35:19.619615+0000","last_fullsized":"2024-04-25T10:35:19.619615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620263+0000","last_change":"2024-04-25T10:33:42.166946+0000","last_active":"2024-04-25T10:35:19.620263+0000","last_peered":"2024-04-25T10:35:19.620263+0000","last_clean":"2024-04-25T10:35:19.620263+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:35:19.620263+0000","last_undegraded":"2024-04-25T10:35:19.620263+0000","last_fullsized":"2024-04-25T10:35:19.620263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:29.817932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592050+0000","last_change":"2024-04-25T10:33:43.170510+0000","last_active":"2024-04-25T10:35:19.592050+0000","last_peered":"2024-04-25T10:35:19.592050+0000","last_clean":"2024-04-25T10:35:19.592050+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:35:19.592050+0000","last_undegraded":"2024-04-25T10:35:19.592050+0000","last_fullsized":"2024-04-25T10:35:19.592050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590156+0000","last_change":"2024-04-25T10:33:42.165204+0000","last_active":"2024-04-25T10:35:19.590156+0000","last_peered":"2024-04-25T10:35:19.590156+0000","last_clean":"2024-04-25T10:35:19.590156+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:35:19.590156+0000","last_undegraded":"2024-04-25T10:35:19.590156+0000","last_fullsized":"2024-04-25T10:35:19.590156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599436+0000","last_change":"2024-04-25T10:33:43.168088+0000","last_active":"2024-04-25T10:35:19.599436+0000","last_peered":"2024-04-25T10:35:19.599436+0000","last_clean":"2024-04-25T10:35:19.599436+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:35:19.599436+0000","last_undegraded":"2024-04-25T10:35:19.599436+0000","last_fullsized":"2024-04-25T10:35:19.599436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590347+0000","last_change":"2024-04-25T10:33:42.156381+0000","last_active":"2024-04-25T10:35:19.590347+0000","last_peered":"2024-04-25T10:35:19.590347+0000","last_clean":"2024-04-25T10:35:19.590347+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:35:19.590347+0000","last_undegraded":"2024-04-25T10:35:19.590347+0000","last_fullsized":"2024-04-25T10:35:19.590347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599508+0000","last_change":"2024-04-25T10:33:43.167502+0000","last_active":"2024-04-25T10:35:19.599508+0000","last_peered":"2024-04-25T10:35:19.599508+0000","last_clean":"2024-04-25T10:35:19.599508+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:35:19.599508+0000","last_undegraded":"2024-04-25T10:35:19.599508+0000","last_fullsized":"2024-04-25T10:35:19.599508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620596+0000","last_change":"2024-04-25T10:33:42.168840+0000","last_active":"2024-04-25T10:35:19.620596+0000","last_peered":"2024-04-25T10:35:19.620596+0000","last_clean":"2024-04-25T10:35:19.620596+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:35:19.620596+0000","last_undegraded":"2024-04-25T10:35:19.620596+0000","last_fullsized":"2024-04-25T10:35:19.620596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:51.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593984+0000","last_change":"2024-04-25T10:33:43.174672+0000","last_active":"2024-04-25T10:35:19.593984+0000","last_peered":"2024-04-25T10:35:19.593984+0000","last_clean":"2024-04-25T10:35:19.593984+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:35:19.593984+0000","last_undegraded":"2024-04-25T10:35:19.593984+0000","last_fullsized":"2024-04-25T10:35:19.593984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'1","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591576+0000","last_change":"2024-04-25T10:33:43.179274+0000","last_active":"2024-04-25T10:35:19.591576+0000","last_peered":"2024-04-25T10:35:19.591576+0000","last_clean":"2024-04-25T10:35:19.591576+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:35:19.591576+0000","last_undegraded":"2024-04-25T10:35:19.591576+0000","last_fullsized":"2024-04-25T10:35:19.591576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:24.341521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620487+0000","last_change":"2024-04-25T10:33:42.168654+0000","last_active":"2024-04-25T10:35:19.620487+0000","last_peered":"2024-04-25T10:35:19.620487+0000","last_clean":"2024-04-25T10:35:19.620487+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:35:19.620487+0000","last_undegraded":"2024-04-25T10:35:19.620487+0000","last_fullsized":"2024-04-25T10:35:19.620487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:15.158541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591205+0000","last_change":"2024-04-25T10:33:43.170923+0000","last_active":"2024-04-25T10:35:19.591205+0000","last_peered":"2024-04-25T10:35:19.591205+0000","last_clean":"2024-04-25T10:35:19.591205+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:35:19.591205+0000","last_undegraded":"2024-04-25T10:35:19.591205+0000","last_fullsized":"2024-04-25T10:35:19.591205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620653+0000","last_change":"2024-04-25T10:33:42.171374+0000","last_active":"2024-04-25T10:35:19.620653+0000","last_peered":"2024-04-25T10:35:19.620653+0000","last_clean":"2024-04-25T10:35:19.620653+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:35:19.620653+0000","last_undegraded":"2024-04-25T10:35:19.620653+0000","last_fullsized":"2024-04-25T10:35:19.620653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:41.709015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619407+0000","last_change":"2024-04-25T10:33:43.172788+0000","last_active":"2024-04-25T10:35:19.619407+0000","last_peered":"2024-04-25T10:35:19.619407+0000","last_clean":"2024-04-25T10:35:19.619407+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:35:19.619407+0000","last_undegraded":"2024-04-25T10:35:19.619407+0000","last_fullsized":"2024-04-25T10:35:19.619407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599727+0000","last_change":"2024-04-25T10:33:42.161364+0000","last_active":"2024-04-25T10:35:19.599727+0000","last_peered":"2024-04-25T10:35:19.599727+0000","last_clean":"2024-04-25T10:35:19.599727+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:35:19.599727+0000","last_undegraded":"2024-04-25T10:35:19.599727+0000","last_fullsized":"2024-04-25T10:35:19.599727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599690+0000","last_change":"2024-04-25T10:33:43.177654+0000","last_active":"2024-04-25T10:35:19.599690+0000","last_peered":"2024-04-25T10:35:19.599690+0000","last_clean":"2024-04-25T10:35:19.599690+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:35:19.599690+0000","last_undegraded":"2024-04-25T10:35:19.599690+0000","last_fullsized":"2024-04-25T10:35:19.599690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619679+0000","last_change":"2024-04-25T10:33:42.167156+0000","last_active":"2024-04-25T10:35:19.619679+0000","last_peered":"2024-04-25T10:35:19.619679+0000","last_clean":"2024-04-25T10:35:19.619679+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:35:19.619679+0000","last_undegraded":"2024-04-25T10:35:19.619679+0000","last_fullsized":"2024-04-25T10:35:19.619679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68881,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":109,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":137762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":680177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":156603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":89317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":89353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":157310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":233472,"data_stored":83823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":249856,"data_stored":89387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":847872,"data_stored":680233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:35:25.792 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:35:25.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.935+0000 7f4b96092640 1 Processor -- start 2024-04-25T10:35:25.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.935+0000 7f4b96092640 1 -- start start 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b96092640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b900720e0 0x7f4b900b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b96092640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 0x7f4b900b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b96092640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b901472a0 0x7f4b900b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b96092640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4b90071970 con 0x7f4b901472a0 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b96092640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f4b900b27c0 con 0x7f4b900720e0 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b96092640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f4b900b2a80 con 0x7f4b900b23b0 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b901472a0 0x7f4b900b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4b901472a0 0x7f4b900b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50704/0 (socket says 172.21.15.103:50704) 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8ffff640 1 -- 172.21.15.103:0/3763406158 learned_addr learned my addr 172.21.15.103:0/3763406158 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8effd640 1 --2- 172.21.15.103:0/3763406158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 0x7f4b900b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8f7fe640 1 --2- 172.21.15.103:0/3763406158 >> v2:172.21.15.132:3300/0 conn(0x7f4b900720e0 0x7f4b900b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8ffff640 1 -- 172.21.15.103:0/3763406158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 msgr2=0x7f4b900b84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8ffff640 1 --2- 172.21.15.103:0/3763406158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 0x7f4b900b84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8ffff640 1 -- 172.21.15.103:0/3763406158 >> v2:172.21.15.132:3300/0 conn(0x7f4b900720e0 msgr2=0x7f4b900b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8ffff640 1 --2- 172.21.15.103:0/3763406158 >> v2:172.21.15.132:3300/0 conn(0x7f4b900720e0 0x7f4b900b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.936+0000 7f4b8ffff640 1 -- 172.21.15.103:0/3763406158 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b90071bc0 con 0x7f4b901472a0 2024-04-25T10:35:25.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.937+0000 7f4b8ffff640 1 --2- 172.21.15.103:0/3763406158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b901472a0 0x7f4b900b5fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4b900b9150 tx=0x7f4b8802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b672e99b8b59e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.937+0000 7f4b8e7fc640 1 -- 172.21.15.103:0/3763406158 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88036070 con 0x7f4b901472a0 2024-04-25T10:35:25.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.937+0000 7f4b8e7fc640 1 -- 172.21.15.103:0/3763406158 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b88031600 con 0x7f4b901472a0 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.937+0000 7f4b8e7fc640 1 -- 172.21.15.103:0/3763406158 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880319d0 con 0x7f4b901472a0 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 -- 172.21.15.103:0/3763406158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b901472a0 msgr2=0x7f4b900b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 --2- 172.21.15.103:0/3763406158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b901472a0 0x7f4b900b5fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4b900b9150 tx=0x7f4b8802a610 comp rx=0 tx=0).stop 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 -- 172.21.15.103:0/3763406158 shutdown_connections 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 --2- 172.21.15.103:0/3763406158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b901472a0 0x7f4b900b5fa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 --2- 172.21.15.103:0/3763406158 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 0x7f4b900b84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 --2- 172.21.15.103:0/3763406158 >> v2:172.21.15.132:3300/0 conn(0x7f4b900720e0 0x7f4b900b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 -- 172.21.15.103:0/3763406158 >> 172.21.15.103:0/3763406158 conn(0x7f4b900b93f0 msgr2=0x7f4b900b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 -- 172.21.15.103:0/3763406158 shutdown_connections 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.938+0000 7f4b96092640 1 -- 172.21.15.103:0/3763406158 wait complete. 2024-04-25T10:35:25.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.939+0000 7f4b96092640 1 Processor -- start 2024-04-25T10:35:25.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.939+0000 7f4b96092640 1 -- start start 2024-04-25T10:35:25.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b96092640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b900720e0 0x7f4b90145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b96092640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 0x7f4b9013caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b96092640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b901472a0 0x7f4b9013cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b96092640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4b900b6660 con 0x7f4b900720e0 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b96092640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4b900b64e0 con 0x7f4b901472a0 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b96092640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f4b90070670 con 0x7f4b900b23b0 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b8f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b900720e0 0x7f4b90145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b8f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b900720e0 0x7f4b90145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50706/0 (socket says 172.21.15.103:50706) 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.940+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/2742604786 learned_addr learned my addr 172.21.15.103:0/2742604786 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b8ffff640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b901472a0 0x7f4b9013cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b8effd640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 0x7f4b9013caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/2742604786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 msgr2=0x7f4b9013caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b8f7fe640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 0x7f4b9013caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/2742604786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b901472a0 msgr2=0x7f4b9013cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:25.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b8f7fe640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b901472a0 0x7f4b9013cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b8f7fe640 1 -- 172.21.15.103:0/2742604786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b90149820 con 0x7f4b900720e0 2024-04-25T10:35:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b8f7fe640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b900720e0 0x7f4b90145900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000d620 tx=0x7f4b8000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b77fff640 1 -- 172.21.15.103:0/2742604786 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000b620 con 0x7f4b900720e0 2024-04-25T10:35:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b77fff640 1 -- 172.21.15.103:0/2742604786 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b80019070 con 0x7f4b900720e0 2024-04-25T10:35:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b900bc530 con 0x7f4b900720e0 2024-04-25T10:35:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b77fff640 1 -- 172.21.15.103:0/2742604786 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000ba00 con 0x7f4b900720e0 2024-04-25T10:35:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.941+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b90148870 con 0x7f4b900720e0 2024-04-25T10:35:25.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.942+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9006a130 con 0x7f4b900720e0 2024-04-25T10:35:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.943+0000 7f4b77fff640 1 -- 172.21.15.103:0/2742604786 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4b8000bba0 con 0x7f4b900720e0 2024-04-25T10:35:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.943+0000 7f4b77fff640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4b7c0744b0 0x7f4b7c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.944+0000 7f4b8effd640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4b7c0744b0 0x7f4b7c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.944+0000 7f4b77fff640 1 -- 172.21.15.103:0/2742604786 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f4b80095440 con 0x7f4b900720e0 2024-04-25T10:35:25.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.944+0000 7f4b8effd640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4b7c0744b0 0x7f4b7c0769c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b900715a0 tx=0x7f4b84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:25.948+0000 7f4b77fff640 1 -- 172.21.15.103:0/2742604786 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4b8005f600 con 0x7f4b900720e0 2024-04-25T10:35:26.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.129+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b901466a0 con 0x7f4b900720e0 2024-04-25T10:35:26.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.130+0000 7f4b77fff640 1 -- 172.21.15.103:0/2742604786 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16975 (secure 0 0 0) 0x7f4b80063900 con 0x7f4b900720e0 2024-04-25T10:35:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:35:26.132 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":23,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:35:19.586756+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/2236094452":"2024-04-25T11:35:18.787637+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:35:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4b7c0744b0 msgr2=0x7f4b7c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4b7c0744b0 0x7f4b7c0769c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b900715a0 tx=0x7f4b84008040 comp rx=0 tx=0).stop 2024-04-25T10:35:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b900720e0 msgr2=0x7f4b90145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:26.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b900720e0 0x7f4b90145900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000d620 tx=0x7f4b8000dae0 comp rx=0 tx=0).stop 2024-04-25T10:35:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 shutdown_connections 2024-04-25T10:35:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f4b7c0744b0 0x7f4b7c0769c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b901472a0 0x7f4b9013cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b900b23b0 0x7f4b9013caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 --2- 172.21.15.103:0/2742604786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b900720e0 0x7f4b90145900 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 >> 172.21.15.103:0/2742604786 conn(0x7f4b900b93f0 msgr2=0x7f4b9013fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.132+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 shutdown_connections 2024-04-25T10:35:26.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:26.133+0000 7f4b96092640 1 -- 172.21.15.103:0/2742604786 wait complete. 2024-04-25T10:35:27.148 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T10:35:27.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:35:27.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.273+0000 7f043ea1a640 1 Processor -- start 2024-04-25T10:35:27.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.273+0000 7f043ea1a640 1 -- start start 2024-04-25T10:35:27.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.274+0000 7f043ea1a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04380719a0 0x7f04380b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.274+0000 7f043ea1a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04380b9210 con 0x7f043814a7e0 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.274+0000 7f043ea1a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0438071db0 con 0x7f0438071390 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.274+0000 7f043ea1a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f04380708b0 con 0x7f04380719a0 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.274+0000 7f04377fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04380719a0 0x7f04380b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.275+0000 7f04377fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04380719a0 0x7f04380b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50716/0 (socket says 172.21.15.103:50716) 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.274+0000 7f043cfb7640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f043814a7e0 0x7f0438151b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48266/0 (socket says 172.21.15.103:48266) 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.275+0000 7f04377fe640 1 -- 172.21.15.103:0/2202526066 learned_addr learned my addr 172.21.15.103:0/2202526066 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.275+0000 7f04377fe640 1 -- 172.21.15.103:0/2202526066 >> v1:172.21.15.132:6789/0 conn(0x7f0438071390 legacy=0x7f04380b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.275+0000 7f04377fe640 1 -- 172.21.15.103:0/2202526066 >> v1:172.21.15.103:6789/0 conn(0x7f043814a7e0 legacy=0x7f0438151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.275+0000 7f04377fe640 1 -- 172.21.15.103:0/2202526066 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0438070b90 con 0x7f04380719a0 2024-04-25T10:35:27.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.275+0000 7f0436ffd640 1 -- 172.21.15.103:0/2202526066 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992440537 0 0) 0x7f04380b9210 con 0x7f043814a7e0 2024-04-25T10:35:27.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f04377fe640 1 --2- 172.21.15.103:0/2202526066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 0x7f04380b8550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f042c009870 tx=0x7f042c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f64205c8f81b635 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f0436ffd640 1 -- 172.21.15.103:0/2202526066 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c037070 con 0x7f04380719a0 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f0436ffd640 1 -- 172.21.15.103:0/2202526066 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c032440 con 0x7f04380719a0 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f0436ffd640 1 -- 172.21.15.103:0/2202526066 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c032810 con 0x7f04380719a0 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f043ea1a640 1 -- 172.21.15.103:0/2202526066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 msgr2=0x7f04380b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f043ea1a640 1 --2- 172.21.15.103:0/2202526066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 0x7f04380b8550 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f042c009870 tx=0x7f042c02a210 comp rx=0 tx=0).stop 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f043ea1a640 1 -- 172.21.15.103:0/2202526066 shutdown_connections 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f043ea1a640 1 --2- 172.21.15.103:0/2202526066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 0x7f04380b8550 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f043ea1a640 1 -- 172.21.15.103:0/2202526066 >> 172.21.15.103:0/2202526066 conn(0x7f04380b9460 msgr2=0x7f04380b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f043ea1a640 1 -- 172.21.15.103:0/2202526066 shutdown_connections 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.276+0000 7f043ea1a640 1 -- 172.21.15.103:0/2202526066 wait complete. 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.278+0000 7f043ea1a640 1 Processor -- start 2024-04-25T10:35:27.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.278+0000 7f043ea1a640 1 -- start start 2024-04-25T10:35:27.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f043ea1a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0438071390 0x7f0438147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f043ea1a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 0x7f04381e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f043ea1a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f043814a7e0 0x7f043813a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f043ea1a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f043814abf0 con 0x7f04380719a0 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f043ea1a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0438072580 con 0x7f0438071390 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f043ea1a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f04380b6620 con 0x7f043814a7e0 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f04377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 0x7f04381e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f04377fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 0x7f04381e0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50728/0 (socket says 172.21.15.103:50728) 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f04377fe640 1 -- 172.21.15.103:0/449376175 learned_addr learned my addr 172.21.15.103:0/449376175 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f0437fff640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0438071390 0x7f0438147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f043cfb7640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f043814a7e0 0x7f043813a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.279+0000 7f04377fe640 1 -- 172.21.15.103:0/449376175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f043814a7e0 msgr2=0x7f043813a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f04377fe640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f043814a7e0 0x7f043813a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f04377fe640 1 -- 172.21.15.103:0/449376175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0438071390 msgr2=0x7f0438147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f04377fe640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0438071390 0x7f0438147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f04377fe640 1 -- 172.21.15.103:0/449376175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04381e1200 con 0x7f04380719a0 2024-04-25T10:35:27.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f0437fff640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0438071390 0x7f0438147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:27.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f04377fe640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 0x7f04381e0cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f042c000c00 tx=0x7f042c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c041070 con 0x7f04380719a0 2024-04-25T10:35:27.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c03c870 con 0x7f04380719a0 2024-04-25T10:35:27.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04381e1410 con 0x7f04380719a0 2024-04-25T10:35:27.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c037040 con 0x7f04380719a0 2024-04-25T10:35:27.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.280+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0438142070 con 0x7f04380719a0 2024-04-25T10:35:27.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.281+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04381e08a0 con 0x7f04380719a0 2024-04-25T10:35:27.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.282+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f042c044070 con 0x7f04380719a0 2024-04-25T10:35:27.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.282+0000 7f0434ff9640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f04240744e0 0x7f04240769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.282+0000 7f0437fff640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f04240744e0 0x7f04240769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.282+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f042c0b5d10 con 0x7f04380719a0 2024-04-25T10:35:27.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.282+0000 7f0434ff9640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7f042407c900 0x7f042407edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.282+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f042c048e50 con 0x7f042407c900 2024-04-25T10:35:27.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.282+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f042c0b9020 con 0x7f04380719a0 2024-04-25T10:35:27.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.282+0000 7f043cfb7640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7f042407c900 0x7f042407edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.283+0000 7f0437fff640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f04240744e0 0x7f04240769f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0438071930 tx=0x7f0428008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.283+0000 7f043cfb7640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7f042407c900 0x7f042407edd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.283+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 <== osd.0 v2:172.21.15.103:6808/1654732884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f042c048e50 con 0x7f042407c900 2024-04-25T10:35:27.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.296+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 --> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0438141bc0 con 0x7f042407c900 2024-04-25T10:35:27.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f0434ff9640 1 -- 172.21.15.103:0/449376175 <== osd.0 v2:172.21.15.103:6808/1654732884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0438141bc0 con 0x7f042407c900 2024-04-25T10:35:27.298 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:35:27.298 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:35:27.299 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:35:27.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7f042407c900 msgr2=0x7f042407edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6808/1654732884,v1:172.21.15.103:6809/1654732884] conn(0x7f042407c900 0x7f042407edd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f04240744e0 msgr2=0x7f04240769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f04240744e0 0x7f04240769f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0438071930 tx=0x7f0428008040 comp rx=0 tx=0).stop 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 msgr2=0x7f04381e0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 --2- 172.21.15.103:0/449376175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04380719a0 0x7f04381e0cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f042c000c00 tx=0x7f042c0046c0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043cfb7640 1 -- 172.21.15.103:0/449376175 reap_dead start 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 shutdown_connections 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 >> 172.21.15.103:0/449376175 conn(0x7f04380b9460 msgr2=0x7f04380b7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 shutdown_connections 2024-04-25T10:35:27.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.297+0000 7f043ea1a640 1 -- 172.21.15.103:0/449376175 wait complete. 2024-04-25T10:35:27.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T10:35:27.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.417+0000 7f458a714640 1 Processor -- start 2024-04-25T10:35:27.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.417+0000 7f458a714640 1 -- start start 2024-04-25T10:35:27.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f458a714640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45840b3fc0 0x7f45840b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f458a714640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f45840b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f458a714640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45840b4cc0 con 0x7f458406c7a0 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f458a714640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f45840b43d0 con 0x7f45840b3fc0 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f458a714640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f45840b4fa0 con 0x7f45840b6420 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f4583fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45840b3fc0 0x7f45840b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f4583fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45840b3fc0 0x7f45840b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50744/0 (socket says 172.21.15.103:50744) 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f4583fff640 1 -- 172.21.15.103:0/1588734375 learned_addr learned my addr 172.21.15.103:0/1588734375 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f4588cb1640 1 --2- 172.21.15.103:0/1588734375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f45840b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f4583fff640 1 -- 172.21.15.103:0/1588734375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 msgr2=0x7f45840b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f4583fff640 1 --2- 172.21.15.103:0/1588734375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f45840b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f4583fff640 1 -- 172.21.15.103:0/1588734375 >> v1:172.21.15.132:6789/0 conn(0x7f458406c7a0 legacy=0x7f4584141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.418+0000 7f4583fff640 1 -- 172.21.15.103:0/1588734375 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458406cbb0 con 0x7f45840b3fc0 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.419+0000 7f4583fff640 1 --2- 172.21.15.103:0/1588734375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45840b8aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4574009870 tx=0x7f457402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78d24e0a8af4a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.419+0000 7f4582ffd640 1 -- 172.21.15.103:0/1588734375 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574037070 con 0x7f45840b3fc0 2024-04-25T10:35:27.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.419+0000 7f4582ffd640 1 -- 172.21.15.103:0/1588734375 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4574032440 con 0x7f45840b3fc0 2024-04-25T10:35:27.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.419+0000 7f4582ffd640 1 -- 172.21.15.103:0/1588734375 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574032810 con 0x7f45840b3fc0 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.420+0000 7f458a714640 1 -- 172.21.15.103:0/1588734375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 msgr2=0x7f45840b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.420+0000 7f458a714640 1 --2- 172.21.15.103:0/1588734375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45840b8aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4574009870 tx=0x7f457402a270 comp rx=0 tx=0).stop 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.420+0000 7f458a714640 1 -- 172.21.15.103:0/1588734375 shutdown_connections 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.420+0000 7f458a714640 1 --2- 172.21.15.103:0/1588734375 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f45840b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.420+0000 7f458a714640 1 --2- 172.21.15.103:0/1588734375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45840b8aa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.420+0000 7f458a714640 1 -- 172.21.15.103:0/1588734375 >> 172.21.15.103:0/1588734375 conn(0x7f45840bc9a0 msgr2=0x7f45840bcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.420+0000 7f458a714640 1 -- 172.21.15.103:0/1588734375 shutdown_connections 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.420+0000 7f458a714640 1 -- 172.21.15.103:0/1588734375 wait complete. 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.421+0000 7f458a714640 1 Processor -- start 2024-04-25T10:35:27.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.421+0000 7f458a714640 1 -- start start 2024-04-25T10:35:27.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.422+0000 7f458a714640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406c7a0 0x7f45841df360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.422+0000 7f458a714640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45841e11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.422+0000 7f458a714640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f4584138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.422+0000 7f458a714640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4584141b20 con 0x7f45840b3fc0 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.422+0000 7f458a714640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4584151d60 con 0x7f458406c7a0 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.422+0000 7f458a714640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f45841dfd70 con 0x7f45840b6420 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45841e11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45841e11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50760/0 (socket says 172.21.15.103:50760) 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 -- 172.21.15.103:0/1606632425 learned_addr learned my addr 172.21.15.103:0/1606632425 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f4583fff640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406c7a0 0x7f45841df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f4588cb1640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f4584138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 -- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 msgr2=0x7f4584138ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f4584138ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 -- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406c7a0 msgr2=0x7f45841df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406c7a0 0x7f45841df360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 -- 172.21.15.103:0/1606632425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45841df8a0 con 0x7f45840b3fc0 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f4588cb1640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f4584138ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f4583fff640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406c7a0 0x7f45841df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f45837fe640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45841e11f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f457800c3f0 tx=0x7f457800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f4580ff9640 1 -- 172.21.15.103:0/1606632425 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45780052d0 con 0x7f45840b3fc0 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f4580ff9640 1 -- 172.21.15.103:0/1606632425 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4578005490 con 0x7f45840b3fc0 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45841e1730 con 0x7f45840b3fc0 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f4580ff9640 1 -- 172.21.15.103:0/1606632425 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578007260 con 0x7f45840b3fc0 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.423+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45841e1cd0 con 0x7f45840b3fc0 2024-04-25T10:35:27.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.424+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4584145410 con 0x7f45840b3fc0 2024-04-25T10:35:27.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.425+0000 7f4580ff9640 1 -- 172.21.15.103:0/1606632425 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f4578007400 con 0x7f45840b3fc0 2024-04-25T10:35:27.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.425+0000 7f4580ff9640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f45700744b0 0x7f45700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.425+0000 7f4583fff640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f45700744b0 0x7f45700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.425+0000 7f4580ff9640 1 -- 172.21.15.103:0/1606632425 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f4578094760 con 0x7f45840b3fc0 2024-04-25T10:35:27.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.426+0000 7f4583fff640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f45700744b0 0x7f45700769c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4574034000 tx=0x7f457402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.430+0000 7f4580ff9640 1 -- 172.21.15.103:0/1606632425 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f457805ee50 con 0x7f45840b3fc0 2024-04-25T10:35:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.607+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f458406a130 con 0x7f45700744b0 2024-04-25T10:35:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.608+0000 7f4580ff9640 1 -- 172.21.15.103:0/1606632425 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f458406a130 con 0x7f45700744b0 2024-04-25T10:35:27.610 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T10:35:27.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f45700744b0 msgr2=0x7f45700769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f45700744b0 0x7f45700769c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4574034000 tx=0x7f457402e000 comp rx=0 tx=0).stop 2024-04-25T10:35:27.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 msgr2=0x7f45841e11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45841e11f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f457800c3f0 tx=0x7f457800c8b0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 shutdown_connections 2024-04-25T10:35:27.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f45700744b0 0x7f45700769c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f45840b6420 0x7f4584138ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45840b3fc0 0x7f45841e11f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 --2- 172.21.15.103:0/1606632425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f458406c7a0 0x7f45841df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 >> 172.21.15.103:0/1606632425 conn(0x7f45840bc9a0 msgr2=0x7f45840b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:27.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.610+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 shutdown_connections 2024-04-25T10:35:27.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.611+0000 7f458a714640 1 -- 172.21.15.103:0/1606632425 wait complete. 2024-04-25T10:35:27.624 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T10:35:27.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:35:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.734+0000 7fbe772b1640 1 Processor -- start 2024-04-25T10:35:27.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.734+0000 7fbe772b1640 1 -- start start 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe772b1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbe7006e330 0x7fbe70070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe772b1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe70071ad0 con 0x7fbe70143730 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe772b1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe70143b40 con 0x7fbe70072290 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe772b1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbe70070c50 con 0x7fbe7006e330 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe7484c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbe70143730 0x7fbe7006dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48280/0 (socket says 172.21.15.103:48280) 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe7484c640 1 -- 172.21.15.103:0/2660114843 learned_addr learned my addr 172.21.15.103:0/2660114843 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe7584e640 1 --2- 172.21.15.103:0/2660114843 >> v2:172.21.15.103:3300/0 conn(0x7fbe7006e330 0x7fbe70070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe7584e640 1 -- 172.21.15.103:0/2660114843 >> v1:172.21.15.132:6789/0 conn(0x7fbe70072290 legacy=0x7fbe700b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe7584e640 1 -- 172.21.15.103:0/2660114843 >> v1:172.21.15.103:6789/0 conn(0x7fbe70143730 legacy=0x7fbe7006dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe7584e640 1 -- 172.21.15.103:0/2660114843 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7006e940 con 0x7fbe7006e330 2024-04-25T10:35:27.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.735+0000 7fbe67fff640 1 -- 172.21.15.103:0/2660114843 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065466572 0 0) 0x7fbe70071ad0 con 0x7fbe70143730 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.736+0000 7fbe7584e640 1 --2- 172.21.15.103:0/2660114843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 0x7fbe70070710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009dc0 tx=0x7fbe6802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4d1b296d307634 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.736+0000 7fbe67fff640 1 -- 172.21.15.103:0/2660114843 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68007740 con 0x7fbe7006e330 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.736+0000 7fbe67fff640 1 -- 172.21.15.103:0/2660114843 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe680078e0 con 0x7fbe7006e330 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.736+0000 7fbe67fff640 1 -- 172.21.15.103:0/2660114843 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68007cb0 con 0x7fbe7006e330 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.737+0000 7fbe772b1640 1 -- 172.21.15.103:0/2660114843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 msgr2=0x7fbe70070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.737+0000 7fbe772b1640 1 --2- 172.21.15.103:0/2660114843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 0x7fbe70070710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009dc0 tx=0x7fbe6802a5b0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.737+0000 7fbe772b1640 1 -- 172.21.15.103:0/2660114843 shutdown_connections 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.737+0000 7fbe772b1640 1 --2- 172.21.15.103:0/2660114843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 0x7fbe70070710 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.737+0000 7fbe772b1640 1 -- 172.21.15.103:0/2660114843 >> 172.21.15.103:0/2660114843 conn(0x7fbe700b9460 msgr2=0x7fbe700b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.737+0000 7fbe772b1640 1 -- 172.21.15.103:0/2660114843 shutdown_connections 2024-04-25T10:35:27.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.737+0000 7fbe772b1640 1 -- 172.21.15.103:0/2660114843 wait complete. 2024-04-25T10:35:27.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.739+0000 7fbe772b1640 1 Processor -- start 2024-04-25T10:35:27.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.739+0000 7fbe772b1640 1 -- start start 2024-04-25T10:35:27.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe772b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 0x7fbe70145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe772b1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe70072290 0x7fbe700b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe772b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe70143730 0x7fbe700b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe772b1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbe70155110 con 0x7fbe7006e330 2024-04-25T10:35:27.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe772b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbe70154f90 con 0x7fbe70143730 2024-04-25T10:35:27.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe772b1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fbe70155290 con 0x7fbe70072290 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 0x7fbe70145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 0x7fbe70145b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50784/0 (socket says 172.21.15.103:50784) 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 -- 172.21.15.103:0/1046196696 learned_addr learned my addr 172.21.15.103:0/1046196696 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 -- 172.21.15.103:0/1046196696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe70072290 msgr2=0x7fbe700b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe70072290 0x7fbe700b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 -- 172.21.15.103:0/1046196696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe70143730 msgr2=0x7fbe700b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe70143730 0x7fbe700b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 -- 172.21.15.103:0/1046196696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7013ea40 con 0x7fbe7006e330 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe7504d640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 0x7fbe70145b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00b3f0 tx=0x7fbe6c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c015020 con 0x7fbe7006e330 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6c011830 con 0x7fbe7006e330 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe700b6540 con 0x7fbe7006e330 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.740+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c011c20 con 0x7fbe7006e330 2024-04-25T10:35:27.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.741+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe700b54a0 con 0x7fbe7006e330 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.741+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe700b52b0 con 0x7fbe7006e330 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.742+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fbe6c018020 con 0x7fbe7006e330 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.742+0000 7fbe65ffb640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbe540744b0 0x7fbe540769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.743+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fbe6c094e10 con 0x7fbe7006e330 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.743+0000 7fbe7484c640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbe540744b0 0x7fbe540769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.743+0000 7fbe65ffb640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7fbe5407c8d0 0x7fbe5407eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.743+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 --> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe6c00de50 con 0x7fbe5407c8d0 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.743+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fbe6c097510 con 0x7fbe7006e330 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.743+0000 7fbe7584e640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7fbe5407c8d0 0x7fbe5407eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.743+0000 7fbe7484c640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbe540744b0 0x7fbe540769c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe60005880 tx=0x7fbe60007a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.743+0000 7fbe7584e640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7fbe5407c8d0 0x7fbe5407eda0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.744+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 <== osd.1 v2:172.21.15.103:6816/1963339576 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe6c00de50 con 0x7fbe5407c8d0 2024-04-25T10:35:27.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 --> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbe7006a130 con 0x7fbe5407c8d0 2024-04-25T10:35:27.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe65ffb640 1 -- 172.21.15.103:0/1046196696 <== osd.1 v2:172.21.15.103:6816/1963339576 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbe7006a130 con 0x7fbe5407c8d0 2024-04-25T10:35:27.758 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:35:27.759 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:35:27.759 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7fbe5407c8d0 msgr2=0x7fbe5407eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6816/1963339576,v1:172.21.15.103:6817/1963339576] conn(0x7fbe5407c8d0 0x7fbe5407eda0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbe540744b0 msgr2=0x7fbe540769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fbe540744b0 0x7fbe540769c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbe60005880 tx=0x7fbe60007a00 comp rx=0 tx=0).stop 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 msgr2=0x7fbe70145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 --2- 172.21.15.103:0/1046196696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe7006e330 0x7fbe70145b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00b3f0 tx=0x7fbe6c00b8b0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe7584e640 1 -- 172.21.15.103:0/1046196696 reap_dead start 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 shutdown_connections 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 >> 172.21.15.103:0/1046196696 conn(0x7fbe700b9460 msgr2=0x7fbe700a19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 shutdown_connections 2024-04-25T10:35:27.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.757+0000 7fbe772b1640 1 -- 172.21.15.103:0/1046196696 wait complete. 2024-04-25T10:35:27.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T10:35:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.876+0000 7f951afc7640 1 Processor -- start 2024-04-25T10:35:27.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.876+0000 7f951afc7640 1 -- start start 2024-04-25T10:35:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.877+0000 7f951afc7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f951406d6d0 0x7f9514149640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.877+0000 7f951afc7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f951406dae0 0x7f9514153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.877+0000 7f951afc7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95140b9a30 con 0x7f951409d820 2024-04-25T10:35:27.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.877+0000 7f951afc7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f95140b9d10 con 0x7f951406dae0 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.877+0000 7f951afc7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f95140b9ff0 con 0x7f951406d6d0 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.878+0000 7f9519564640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f951406dae0 0x7f9514153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.878+0000 7f9519564640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f951406dae0 0x7f9514153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50800/0 (socket says 172.21.15.103:50800) 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.878+0000 7f9519564640 1 -- 172.21.15.103:0/2385765772 learned_addr learned my addr 172.21.15.103:0/2385765772 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.878+0000 7f9513fff640 1 --2- 172.21.15.103:0/2385765772 >> v2:172.21.15.132:3300/0 conn(0x7f951406d6d0 0x7f9514149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.878+0000 7f9519564640 1 -- 172.21.15.103:0/2385765772 >> v2:172.21.15.132:3300/0 conn(0x7f951406d6d0 msgr2=0x7f9514149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.878+0000 7f9519564640 1 --2- 172.21.15.103:0/2385765772 >> v2:172.21.15.132:3300/0 conn(0x7f951406d6d0 0x7f9514149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.878+0000 7f9519564640 1 -- 172.21.15.103:0/2385765772 >> v1:172.21.15.132:6789/0 conn(0x7f951409d820 legacy=0x7f95140bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:27.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.878+0000 7f9519564640 1 -- 172.21.15.103:0/2385765772 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951409dc30 con 0x7f951406dae0 2024-04-25T10:35:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f9519564640 1 --2- 172.21.15.103:0/2385765772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951406dae0 0x7f9514153ee0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f95140a4b60 tx=0x7f950c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de43c4006ce65e1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f95137fe640 1 -- 172.21.15.103:0/2385765772 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c036070 con 0x7f951406dae0 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f95137fe640 1 -- 172.21.15.103:0/2385765772 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c031600 con 0x7f951406dae0 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f95137fe640 1 -- 172.21.15.103:0/2385765772 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c0319d0 con 0x7f951406dae0 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f951afc7640 1 -- 172.21.15.103:0/2385765772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951406dae0 msgr2=0x7f9514153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f951afc7640 1 --2- 172.21.15.103:0/2385765772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951406dae0 0x7f9514153ee0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f95140a4b60 tx=0x7f950c02a660 comp rx=0 tx=0).stop 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f951afc7640 1 -- 172.21.15.103:0/2385765772 shutdown_connections 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f951afc7640 1 --2- 172.21.15.103:0/2385765772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951406dae0 0x7f9514153ee0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f951afc7640 1 --2- 172.21.15.103:0/2385765772 >> v2:172.21.15.132:3300/0 conn(0x7f951406d6d0 0x7f9514149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f951afc7640 1 -- 172.21.15.103:0/2385765772 >> 172.21.15.103:0/2385765772 conn(0x7f95140bee10 msgr2=0x7f95140bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f951afc7640 1 -- 172.21.15.103:0/2385765772 shutdown_connections 2024-04-25T10:35:27.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.879+0000 7f951afc7640 1 -- 172.21.15.103:0/2385765772 wait complete. 2024-04-25T10:35:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.881+0000 7f951afc7640 1 Processor -- start 2024-04-25T10:35:27.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.881+0000 7f951afc7640 1 -- start start 2024-04-25T10:35:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f951afc7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f951406d6d0 0x7f95140b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f951afc7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f951406dae0 0x7f95141e3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f951afc7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951409d820 0x7f95141df950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f951afc7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95140b9640 con 0x7f951409d820 2024-04-25T10:35:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f951afc7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f95140b94c0 con 0x7f951406d6d0 2024-04-25T10:35:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f951afc7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f9514149b80 con 0x7f951406dae0 2024-04-25T10:35:27.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9519564640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951409d820 0x7f95141df950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9519564640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951409d820 0x7f95141df950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50814/0 (socket says 172.21.15.103:50814) 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9519564640 1 -- 172.21.15.103:0/2292963511 learned_addr learned my addr 172.21.15.103:0/2292963511 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9513fff640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f951406dae0 0x7f95141e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9518d63640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f951406d6d0 0x7f95140b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9519564640 1 -- 172.21.15.103:0/2292963511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f951406dae0 msgr2=0x7f95141e3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9519564640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f951406dae0 0x7f95141e3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9519564640 1 -- 172.21.15.103:0/2292963511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f951406d6d0 msgr2=0x7f95140b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9519564640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f951406d6d0 0x7f95140b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.882+0000 7f9519564640 1 -- 172.21.15.103:0/2292963511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95141e36b0 con 0x7f951409d820 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.883+0000 7f9519564640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951409d820 0x7f95141df950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f950c02ac50 tx=0x7f950c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.883+0000 7f95117fa640 1 -- 172.21.15.103:0/2292963511 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c036050 con 0x7f951409d820 2024-04-25T10:35:27.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.883+0000 7f95117fa640 1 -- 172.21.15.103:0/2292963511 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950c042070 con 0x7f951409d820 2024-04-25T10:35:27.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.883+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951414bd20 con 0x7f951409d820 2024-04-25T10:35:27.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.883+0000 7f95117fa640 1 -- 172.21.15.103:0/2292963511 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950c009510 con 0x7f951409d820 2024-04-25T10:35:27.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.883+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95141e38c0 con 0x7f951409d820 2024-04-25T10:35:27.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.884+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f951406a130 con 0x7f951409d820 2024-04-25T10:35:27.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.885+0000 7f95117fa640 1 -- 172.21.15.103:0/2292963511 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f950c007c50 con 0x7f951409d820 2024-04-25T10:35:27.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.885+0000 7f95117fa640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f95000744e0 0x7f95000769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:27.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.885+0000 7f95117fa640 1 -- 172.21.15.103:0/2292963511 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f950c0b5fd0 con 0x7f951409d820 2024-04-25T10:35:27.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.885+0000 7f9518d63640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f95000744e0 0x7f95000769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:27.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.885+0000 7f9518d63640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f95000744e0 0x7f95000769f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9504006fd0 tx=0x7f9504009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:27.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:27.890+0000 7f95117fa640 1 -- 172.21.15.103:0/2292963511 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f950c080100 con 0x7f951409d820 2024-04-25T10:35:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.066+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f95141df560 con 0x7f95000744e0 2024-04-25T10:35:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.066+0000 7f95117fa640 1 -- 172.21.15.103:0/2292963511 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9504009550 con 0x7f95000744e0 2024-04-25T10:35:28.068 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T10:35:28.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.068+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f95000744e0 msgr2=0x7f95000769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f95000744e0 0x7f95000769f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9504006fd0 tx=0x7f9504009060 comp rx=0 tx=0).stop 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951409d820 msgr2=0x7f95141df950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951409d820 0x7f95141df950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f950c02ac50 tx=0x7f950c004a40 comp rx=0 tx=0).stop 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 shutdown_connections 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f95000744e0 0x7f95000769f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f951409d820 0x7f95141df950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f951406dae0 0x7f95141e3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 --2- 172.21.15.103:0/2292963511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f951406d6d0 0x7f95140b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 >> 172.21.15.103:0/2292963511 conn(0x7f95140bee10 msgr2=0x7f95141475b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 shutdown_connections 2024-04-25T10:35:28.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.069+0000 7f951afc7640 1 -- 172.21.15.103:0/2292963511 wait complete. 2024-04-25T10:35:28.082 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T10:35:28.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:35:28.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.192+0000 7f20189eb640 1 Processor -- start 2024-04-25T10:35:28.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.192+0000 7f20189eb640 1 -- start start 2024-04-25T10:35:28.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.193+0000 7f20189eb640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f201414d630 0x7f20140ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.193+0000 7f20189eb640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20140b8220 con 0x7f20140b7e10 2024-04-25T10:35:28.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.193+0000 7f20189eb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20140b84a0 con 0x7f201406d5d0 2024-04-25T10:35:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.193+0000 7f20189eb640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f20140b8a60 con 0x7f201414d630 2024-04-25T10:35:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.193+0000 7f2012d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f201414d630 0x7f20140ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.193+0000 7f201259c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f20140b7e10 0x7f2014146850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48296/0 (socket says 172.21.15.103:48296) 2024-04-25T10:35:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.193+0000 7f201259c640 1 -- 172.21.15.103:0/2522684597 learned_addr learned my addr 172.21.15.103:0/2522684597 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.194+0000 7f2012d9d640 1 -- 172.21.15.103:0/2522684597 >> v1:172.21.15.132:6789/0 conn(0x7f201406d5d0 legacy=0x7f201414cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.194+0000 7f2012d9d640 1 -- 172.21.15.103:0/2522684597 >> v1:172.21.15.103:6789/0 conn(0x7f20140b7e10 legacy=0x7f2014146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.194+0000 7f201159a640 1 -- 172.21.15.103:0/2522684597 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185941152 0 0) 0x7f2004001110 con 0x7f20140b7e10 2024-04-25T10:35:28.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.194+0000 7f2012d9d640 1 -- 172.21.15.103:0/2522684597 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20140b8780 con 0x7f201414d630 2024-04-25T10:35:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.194+0000 7f2012d9d640 1 --2- 172.21.15.103:0/2522684597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201414d630 0x7f20140ba3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f200c009d90 tx=0x7f200c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8588870f76d0421 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f201159a640 1 -- 172.21.15.103:0/2522684597 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c007740 con 0x7f201414d630 2024-04-25T10:35:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f201159a640 1 -- 172.21.15.103:0/2522684597 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f200c0078e0 con 0x7f201414d630 2024-04-25T10:35:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f201159a640 1 -- 172.21.15.103:0/2522684597 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c007cb0 con 0x7f201414d630 2024-04-25T10:35:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f20189eb640 1 -- 172.21.15.103:0/2522684597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201414d630 msgr2=0x7f20140ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f20189eb640 1 --2- 172.21.15.103:0/2522684597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201414d630 0x7f20140ba3c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f200c009d90 tx=0x7f200c02a660 comp rx=0 tx=0).stop 2024-04-25T10:35:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f20189eb640 1 -- 172.21.15.103:0/2522684597 shutdown_connections 2024-04-25T10:35:28.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f20189eb640 1 --2- 172.21.15.103:0/2522684597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201414d630 0x7f20140ba3c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f20189eb640 1 -- 172.21.15.103:0/2522684597 >> 172.21.15.103:0/2522684597 conn(0x7f20140bf330 msgr2=0x7f20140bb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f20189eb640 1 -- 172.21.15.103:0/2522684597 shutdown_connections 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.195+0000 7f20189eb640 1 -- 172.21.15.103:0/2522684597 wait complete. 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.197+0000 7f20189eb640 1 Processor -- start 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.197+0000 7f20189eb640 1 -- start start 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f20189eb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201406d5d0 0x7f20140b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f20189eb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20140b7e10 0x7f20140b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f20189eb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f201414d630 0x7f20140b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f20189eb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f20141470e0 con 0x7f201406d5d0 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f20189eb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2014146f60 con 0x7f201414d630 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f20189eb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f2014154ef0 con 0x7f20140b7e10 2024-04-25T10:35:28.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201406d5d0 0x7f20140b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201406d5d0 0x7f20140b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50842/0 (socket says 172.21.15.103:50842) 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 -- 172.21.15.103:0/957383830 learned_addr learned my addr 172.21.15.103:0/957383830 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f2011d9b640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20140b7e10 0x7f20140b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f2012d9d640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f201414d630 0x7f20140b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 -- 172.21.15.103:0/957383830 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20140b7e10 msgr2=0x7f20140b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20140b7e10 0x7f20140b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 -- 172.21.15.103:0/957383830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f201414d630 msgr2=0x7f20140b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f201414d630 0x7f20140b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 -- 172.21.15.103:0/957383830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20141e3230 con 0x7f201406d5d0 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.198+0000 7f201259c640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201406d5d0 0x7f20140b4200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f200400c420 tx=0x7f200400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.199+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20040074e0 con 0x7f201406d5d0 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.199+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20040047e0 con 0x7f201406d5d0 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.199+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004004c10 con 0x7f201406d5d0 2024-04-25T10:35:28.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.199+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20141e3510 con 0x7f201406d5d0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.199+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20140b00e0 con 0x7f201406d5d0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.200+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f201406a130 con 0x7f201406d5d0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.200+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f2004011070 con 0x7f201406d5d0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2002ffd640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ff40744b0 0x7f1ff40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2011d9b640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ff40744b0 0x7f1ff40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f2004094ea0 con 0x7f201406d5d0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2002ffd640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f1ff407c8d0 0x7f1ff407eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 --> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ff407f470 con 0x7f1ff407c8d0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f20040975a0 con 0x7f201406d5d0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2012d9d640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f1ff407c8d0 0x7f1ff407eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2011d9b640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ff40744b0 0x7f1ff40769c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f20140bd280 tx=0x7f2008009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.201+0000 7f2012d9d640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f1ff407c8d0 0x7f1ff407eda0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.202+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 <== osd.2 v2:172.21.15.103:6800/1181469683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ff407f470 con 0x7f1ff407c8d0 2024-04-25T10:35:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 --> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f20140bdf00 con 0x7f1ff407c8d0 2024-04-25T10:35:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f2002ffd640 1 -- 172.21.15.103:0/957383830 <== osd.2 v2:172.21.15.103:6800/1181469683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f20140bdf00 con 0x7f1ff407c8d0 2024-04-25T10:35:28.217 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:35:28.217 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:35:28.217 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f1ff407c8d0 msgr2=0x7f1ff407eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6800/1181469683,v1:172.21.15.103:6801/1181469683] conn(0x7f1ff407c8d0 0x7f1ff407eda0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ff40744b0 msgr2=0x7f1ff40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1ff40744b0 0x7f1ff40769c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f20140bd280 tx=0x7f2008009040 comp rx=0 tx=0).stop 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201406d5d0 msgr2=0x7f20140b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 --2- 172.21.15.103:0/957383830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f201406d5d0 0x7f20140b4200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f200400c420 tx=0x7f200400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f2012d9d640 1 -- 172.21.15.103:0/957383830 reap_dead start 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 shutdown_connections 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 >> 172.21.15.103:0/957383830 conn(0x7f20140bf330 msgr2=0x7f2014146620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 shutdown_connections 2024-04-25T10:35:28.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.215+0000 7f20189eb640 1 -- 172.21.15.103:0/957383830 wait complete. 2024-04-25T10:35:28.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T10:35:28.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.335+0000 7fa4f1251640 1 Processor -- start 2024-04-25T10:35:28.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.335+0000 7fa4f1251640 1 -- start start 2024-04-25T10:35:28.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.336+0000 7fa4f1251640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ec09d680 0x7fa4ec09da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.336+0000 7fa4f1251640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4ec0a0400 0x7fa4ec0a0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.336+0000 7fa4f1251640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4ec09cf80 con 0x7fa4ec09c250 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.336+0000 7fa4f1251640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa4ec09d1a0 con 0x7fa4ec0a0400 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.336+0000 7fa4f1251640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec14a2a0 con 0x7fa4ec09d680 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4ead9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa4ec09c250 0x7fa4ec149740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48306/0 (socket says 172.21.15.103:48306) 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4ead9d640 1 -- 172.21.15.103:0/3302678834 learned_addr learned my addr 172.21.15.103:0/3302678834 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708416644 0 0) 0x7fa4ec09cf80 con 0x7fa4ec09c250 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4d4003520 con 0x7fa4ec09c250 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4eb59e640 1 --2- 172.21.15.103:0/3302678834 >> v2:172.21.15.132:3300/0 conn(0x7fa4ec0a0400 0x7fa4ec0a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4ea59c640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ec09d680 0x7fa4ec09da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2908584578 0 0) 0x7fa4d4003520 con 0x7fa4ec09c250 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ec09d680 msgr2=0x7fa4ec09da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ec09d680 0x7fa4ec09da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 >> v2:172.21.15.132:3300/0 conn(0x7fa4ec0a0400 msgr2=0x7fa4ec0a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 --2- 172.21.15.103:0/3302678834 >> v2:172.21.15.132:3300/0 conn(0x7fa4ec0a0400 0x7fa4ec0a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec14a580 con 0x7fa4ec09c250 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fa4dc001a10 con 0x7fa4ec09c250 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 >> v1:172.21.15.103:6789/0 conn(0x7fa4ec09c250 legacy=0x7fa4ec149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ec09d680 0x7fa4d40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4d4003f30 0x7fa4d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4d4004d40 0x7fa4d4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec09d1a0 con 0x7fa4d4003f30 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec14a2a0 con 0x7fa4d4004d40 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d400bb50 con 0x7fa4ec09d680 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4ea59c640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4d4003f30 0x7fa4d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4ead9d640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ec09d680 0x7fa4d40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.337+0000 7fa4eb59e640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4d4004d40 0x7fa4d4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.338+0000 7fa4ea59c640 1 -- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ec09d680 msgr2=0x7fa4d40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.338+0000 7fa4ea59c640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4ec09d680 0x7fa4d40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.338+0000 7fa4ea59c640 1 -- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4d4004d40 msgr2=0x7fa4d4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.338+0000 7fa4ea59c640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4d4004d40 0x7fa4d4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.338+0000 7fa4ea59c640 1 -- 172.21.15.103:0/3302678834 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d4003520 con 0x7fa4d4003f30 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.338+0000 7fa4ea59c640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4d4003f30 0x7fa4d4004800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0a48d0 tx=0x7fa4d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc16d5408de78a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.338+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0036070 con 0x7fa4d4003f30 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e0031400 con 0x7fa4d4003f30 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4e9d9b640 1 -- 172.21.15.103:0/3302678834 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0009690 con 0x7fa4d4003f30 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4f1251640 1 -- 172.21.15.103:0/3302678834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4d4003f30 msgr2=0x7fa4d4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4f1251640 1 --2- 172.21.15.103:0/3302678834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4d4003f30 0x7fa4d4004800 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0a48d0 tx=0x7fa4d4005830 comp rx=0 tx=0).stop 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4eb59e640 1 -- 172.21.15.103:0/3302678834 reap_dead start 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4f1251640 1 -- 172.21.15.103:0/3302678834 shutdown_connections 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4f1251640 1 -- 172.21.15.103:0/3302678834 >> 172.21.15.103:0/3302678834 conn(0x7fa4ec0bb5e0 msgr2=0x7fa4ec0bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4f1251640 1 -- 172.21.15.103:0/3302678834 shutdown_connections 2024-04-25T10:35:28.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.339+0000 7fa4f1251640 1 -- 172.21.15.103:0/3302678834 wait complete. 2024-04-25T10:35:28.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.341+0000 7fa4f1251640 1 Processor -- start 2024-04-25T10:35:28.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.341+0000 7fa4f1251640 1 -- start start 2024-04-25T10:35:28.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4f1251640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4d4003f30 0x7fa4ec1df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4f1251640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ec0b43c0 0x7fa4ec1e2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4f1251640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ec0b47d0 0x7fa4ec1e2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4f1251640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec149e50 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4f1251640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ec09c660 con 0x7fa4ec0b43c0 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4f1251640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec149fd0 con 0x7fa4d4003f30 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4eb59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ec0b47d0 0x7fa4ec1e2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4eb59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ec0b47d0 0x7fa4ec1e2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50862/0 (socket says 172.21.15.103:50862) 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4eb59e640 1 -- 172.21.15.103:0/4161081853 learned_addr learned my addr 172.21.15.103:0/4161081853 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4ead9d640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4d4003f30 0x7fa4ec1df9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4ea59c640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ec0b43c0 0x7fa4ec1e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4eb59e640 1 -- 172.21.15.103:0/4161081853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4d4003f30 msgr2=0x7fa4ec1df9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4eb59e640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4d4003f30 0x7fa4ec1df9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4eb59e640 1 -- 172.21.15.103:0/4161081853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ec0b43c0 msgr2=0x7fa4ec1e2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4eb59e640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ec0b43c0 0x7fa4ec1e2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.342+0000 7fa4eb59e640 1 -- 172.21.15.103:0/4161081853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec1dff10 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.343+0000 7fa4eb59e640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ec0b47d0 0x7fa4ec1e2e50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec08d1b0 tx=0x7fa4e4011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.343+0000 7fa4d37fe640 1 -- 172.21.15.103:0/4161081853 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4004030 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.343+0000 7fa4d37fe640 1 -- 172.21.15.103:0/4161081853 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e401b070 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.343+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ec0b4f70 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.343+0000 7fa4d37fe640 1 -- 172.21.15.103:0/4161081853 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40043f0 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.343+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ec1e0120 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.344+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ec06a130 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.345+0000 7fa4d37fe640 1 -- 172.21.15.103:0/4161081853 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa4e4012040 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.345+0000 7fa4d37fe640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa4d80744b0 0x7fa4d80769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.345+0000 7fa4ead9d640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa4d80744b0 0x7fa4d80769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.345+0000 7fa4d37fe640 1 -- 172.21.15.103:0/4161081853 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fa4e4094fe0 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.346+0000 7fa4ead9d640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa4d80744b0 0x7fa4d80769c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0020a0 tx=0x7fa4dc006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.350+0000 7fa4d37fe640 1 -- 172.21.15.103:0/4161081853 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4e405f110 con 0x7fa4ec0b47d0 2024-04-25T10:35:28.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.527+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa4ec09ebf0 con 0x7fa4d80744b0 2024-04-25T10:35:28.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.527+0000 7fa4d37fe640 1 -- 172.21.15.103:0/4161081853 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa4ec09ebf0 con 0x7fa4d80744b0 2024-04-25T10:35:28.529 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T10:35:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa4d80744b0 msgr2=0x7fa4d80769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa4d80744b0 0x7fa4d80769c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc0020a0 tx=0x7fa4dc006040 comp rx=0 tx=0).stop 2024-04-25T10:35:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ec0b47d0 msgr2=0x7fa4ec1e2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ec0b47d0 0x7fa4ec1e2e50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec08d1b0 tx=0x7fa4e4011cf0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 shutdown_connections 2024-04-25T10:35:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa4d80744b0 0x7fa4d80769c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4ec0b47d0 0x7fa4ec1e2e50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4ec0b43c0 0x7fa4ec1e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 --2- 172.21.15.103:0/4161081853 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa4d4003f30 0x7fa4ec1df9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.529+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 >> 172.21.15.103:0/4161081853 conn(0x7fa4ec0bb5e0 msgr2=0x7fa4ec09f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.530+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 shutdown_connections 2024-04-25T10:35:28.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.530+0000 7fa4f1251640 1 -- 172.21.15.103:0/4161081853 wait complete. 2024-04-25T10:35:28.542 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T10:35:28.542 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:35:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.653+0000 7f1fa1d84640 1 Processor -- start 2024-04-25T10:35:28.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.653+0000 7f1fa1d84640 1 -- start start 2024-04-25T10:35:28.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.654+0000 7f1fa1d84640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1f9c0b7e10 0x7f1f9c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.654+0000 7f1fa1d84640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1f9c0ba3c0 0x7f1f9c146850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1fa1d84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c146d90 0x7f1f9c14cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1fa1d84640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c0b8a60 con 0x7f1f9c0ba3c0 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1fa1d84640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c0b8220 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1fa1d84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c0b84a0 con 0x7f1f9c146d90 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9affd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1f9c0ba3c0 0x7f1f9c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9affd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1f9c0ba3c0 0x7f1f9c146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50872/0 (socket says 172.21.15.103:50872) 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9affd640 1 -- 172.21.15.103:0/3467158095 learned_addr learned my addr 172.21.15.103:0/3467158095 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9b7fe640 1 --2- 172.21.15.103:0/3467158095 >> v2:172.21.15.132:3300/0 conn(0x7f1f9c0b7e10 0x7f1f9c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9bfff640 1 --2- 172.21.15.103:0/3467158095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c146d90 0x7f1f9c14cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9affd640 1 -- 172.21.15.103:0/3467158095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c146d90 msgr2=0x7f1f9c14cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9affd640 1 --2- 172.21.15.103:0/3467158095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c146d90 0x7f1f9c14cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9affd640 1 -- 172.21.15.103:0/3467158095 >> v2:172.21.15.132:3300/0 conn(0x7f1f9c0b7e10 msgr2=0x7f1f9c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9affd640 1 --2- 172.21.15.103:0/3467158095 >> v2:172.21.15.132:3300/0 conn(0x7f1f9c0b7e10 0x7f1f9c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.655+0000 7f1f9affd640 1 -- 172.21.15.103:0/3467158095 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c0b8780 con 0x7f1f9c0ba3c0 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.656+0000 7f1f9affd640 1 --2- 172.21.15.103:0/3467158095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0ba3c0 0x7f1f9c146850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0a1450 tx=0x7f1f9002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1676ea0758cf30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.656+0000 7f1f9a7fc640 1 -- 172.21.15.103:0/3467158095 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90037070 con 0x7f1f9c0ba3c0 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.656+0000 7f1f9a7fc640 1 -- 172.21.15.103:0/3467158095 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f90032440 con 0x7f1f9c0ba3c0 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.656+0000 7f1f9a7fc640 1 -- 172.21.15.103:0/3467158095 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90032810 con 0x7f1f9c0ba3c0 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.656+0000 7f1fa1d84640 1 -- 172.21.15.103:0/3467158095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0ba3c0 msgr2=0x7f1f9c146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.656+0000 7f1fa1d84640 1 --2- 172.21.15.103:0/3467158095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0ba3c0 0x7f1f9c146850 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0a1450 tx=0x7f1f9002a140 comp rx=0 tx=0).stop 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.657+0000 7f1fa1d84640 1 -- 172.21.15.103:0/3467158095 shutdown_connections 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.657+0000 7f1fa1d84640 1 --2- 172.21.15.103:0/3467158095 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c146d90 0x7f1f9c14cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.657+0000 7f1fa1d84640 1 --2- 172.21.15.103:0/3467158095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0ba3c0 0x7f1f9c146850 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.657+0000 7f1fa1d84640 1 --2- 172.21.15.103:0/3467158095 >> v2:172.21.15.132:3300/0 conn(0x7f1f9c0b7e10 0x7f1f9c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.657+0000 7f1fa1d84640 1 -- 172.21.15.103:0/3467158095 >> 172.21.15.103:0/3467158095 conn(0x7f1f9c0bf330 msgr2=0x7f1f9c0bb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.657+0000 7f1fa1d84640 1 -- 172.21.15.103:0/3467158095 shutdown_connections 2024-04-25T10:35:28.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.657+0000 7f1fa1d84640 1 -- 172.21.15.103:0/3467158095 wait complete. 2024-04-25T10:35:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.658+0000 7f1fa1d84640 1 Processor -- start 2024-04-25T10:35:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.658+0000 7f1fa1d84640 1 -- start start 2024-04-25T10:35:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1fa1d84640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0b7e10 0x7f1f9c141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1fa1d84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c0ba3c0 0x7f1f9c1df150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1fa1d84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f9c146d90 0x7f1f9c0b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1fa1d84640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c14d5e0 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1fa1d84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c14d460 con 0x7f1f9c146d90 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1fa1d84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c14d760 con 0x7f1f9c0ba3c0 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1f9b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0b7e10 0x7f1f9c141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1f9b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0b7e10 0x7f1f9c141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50880/0 (socket says 172.21.15.103:50880) 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1f9b7fe640 1 -- 172.21.15.103:0/920733721 learned_addr learned my addr 172.21.15.103:0/920733721 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1f9affd640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c0ba3c0 0x7f1f9c1df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.659+0000 7f1f9bfff640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f9c146d90 0x7f1f9c0b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f9b7fe640 1 -- 172.21.15.103:0/920733721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c0ba3c0 msgr2=0x7f1f9c1df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f9b7fe640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1f9c0ba3c0 0x7f1f9c1df150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f9b7fe640 1 -- 172.21.15.103:0/920733721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f9c146d90 msgr2=0x7f1f9c0b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f9b7fe640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f9c146d90 0x7f1f9c0b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f9b7fe640 1 -- 172.21.15.103:0/920733721 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c0b2cf0 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f9bfff640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f9c146d90 0x7f1f9c0b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:35:28.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f9b7fe640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0b7e10 0x7f1f9c141b70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00d620 tx=0x7f1f8c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00b620 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8c019070 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00ba00 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c0b2530 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.660+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c0b3570 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.661+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f9c06a130 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.662+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1f8c00bba0 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.662+0000 7f1f83fff640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f880744b0 0x7f1f880769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.662+0000 7f1f9affd640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f880744b0 0x7f1f880769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.662+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f1f8c0960c0 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.662+0000 7f1f83fff640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f1f8807c8d0 0x7f1f8807eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.662+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f8c00cfb0 con 0x7f1f8807c8d0 2024-04-25T10:35:28.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.662+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1f8c096550 con 0x7f1f9c0b7e10 2024-04-25T10:35:28.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.662+0000 7f1f9bfff640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f1f8807c8d0 0x7f1f8807eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.663+0000 7f1f9affd640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f880744b0 0x7f1f880769c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f90034000 tx=0x7f1f9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.663+0000 7f1f9bfff640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f1f8807c8d0 0x7f1f8807eda0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.663+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 <== osd.3 v2:172.21.15.103:6824/2287324132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f8c00cfb0 con 0x7f1f8807c8d0 2024-04-25T10:35:28.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 --> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1f9c0a4610 con 0x7f1f8807c8d0 2024-04-25T10:35:28.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1f83fff640 1 -- 172.21.15.103:0/920733721 <== osd.3 v2:172.21.15.103:6824/2287324132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1f9c0a4610 con 0x7f1f8807c8d0 2024-04-25T10:35:28.678 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:35:28.679 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:35:28.679 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:35:28.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f1f8807c8d0 msgr2=0x7f1f8807eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6824/2287324132,v1:172.21.15.103:6825/2287324132] conn(0x7f1f8807c8d0 0x7f1f8807eda0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f880744b0 msgr2=0x7f1f880769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1f880744b0 0x7f1f880769c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f90034000 tx=0x7f1f9002e000 comp rx=0 tx=0).stop 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0b7e10 msgr2=0x7f1f9c141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 --2- 172.21.15.103:0/920733721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1f9c0b7e10 0x7f1f9c141b70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00d620 tx=0x7f1f8c00dae0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1f9bfff640 1 -- 172.21.15.103:0/920733721 reap_dead start 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 shutdown_connections 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 >> 172.21.15.103:0/920733721 conn(0x7f1f9c0bf330 msgr2=0x7f1f9c1424c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 shutdown_connections 2024-04-25T10:35:28.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.677+0000 7f1fa1d84640 1 -- 172.21.15.103:0/920733721 wait complete. 2024-04-25T10:35:28.691 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T10:35:28.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.798+0000 7fd5a06ee640 1 Processor -- start 2024-04-25T10:35:28.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.798+0000 7fd5a06ee640 1 -- start start 2024-04-25T10:35:28.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd5a06ee640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd59814ca30 0x7fd5980715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd5a06ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd59806f110 0x7fd59814d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd5a06ee640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59806dde0 con 0x7fd59806ed00 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd5a06ee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd598071ae0 con 0x7fd59806f110 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd5a06ee640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fd598071110 con 0x7fd59814ca30 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59dc89640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd59806ed00 0x7fd59806d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48308/0 (socket says 172.21.15.103:48308) 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59dc89640 1 -- 172.21.15.103:0/1295558135 learned_addr learned my addr 172.21.15.103:0/1295558135 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59e48a640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd59814ca30 0x7fd5980715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59ec8b640 1 --2- 172.21.15.103:0/1295558135 >> v2:172.21.15.132:3300/0 conn(0x7fd59806f110 0x7fd59814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333126276 0 0) 0x7fd59806dde0 con 0x7fd59806ed00 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd584003520 con 0x7fd59806ed00 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4272770801 0 0) 0x7fd584003520 con 0x7fd59806ed00 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd59814ca30 msgr2=0x7fd5980715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd59814ca30 0x7fd5980715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 >> v2:172.21.15.132:3300/0 conn(0x7fd59806f110 msgr2=0x7fd59814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 --2- 172.21.15.103:0/1295558135 >> v2:172.21.15.132:3300/0 conn(0x7fd59806f110 0x7fd59814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5980b92a0 con 0x7fd59806ed00 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.799+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fd588001670 con 0x7fd59806ed00 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 >> v1:172.21.15.103:6789/0 conn(0x7fd59806ed00 legacy=0x7fd59806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59d488640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5840039b0 0x7fd584003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59d488640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd584004800 0x7fd584004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59d488640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd59814ca30 0x7fd584005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd598071ae0 con 0x7fd584004800 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd598071110 con 0x7fd5840039b0 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fd58400b9c0 con 0x7fd59814ca30 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59dc89640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd584004800 0x7fd584004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59e48a640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5840039b0 0x7fd584003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59ec8b640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd59814ca30 0x7fd584005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59dc89640 1 -- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd59814ca30 msgr2=0x7fd584005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59dc89640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd59814ca30 0x7fd584005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59dc89640 1 -- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5840039b0 msgr2=0x7fd584003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59dc89640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5840039b0 0x7fd584003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.800+0000 7fd59dc89640 1 -- 172.21.15.103:0/1295558135 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd584003520 con 0x7fd584004800 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.801+0000 7fd59dc89640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd584004800 0x7fd584004c10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd598073900 tx=0x7fd584005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f409788be37048ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.801+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588007d50 con 0x7fd584004800 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.801+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588005ad0 con 0x7fd584004800 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.801+0000 7fd59d488640 1 -- 172.21.15.103:0/1295558135 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588007070 con 0x7fd584004800 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.801+0000 7fd5a06ee640 1 -- 172.21.15.103:0/1295558135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd584004800 msgr2=0x7fd584004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.801+0000 7fd5a06ee640 1 --2- 172.21.15.103:0/1295558135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd584004800 0x7fd584004c10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd598073900 tx=0x7fd584005830 comp rx=0 tx=0).stop 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.801+0000 7fd59ec8b640 1 -- 172.21.15.103:0/1295558135 reap_dead start 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.802+0000 7fd5a06ee640 1 -- 172.21.15.103:0/1295558135 shutdown_connections 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.802+0000 7fd5a06ee640 1 -- 172.21.15.103:0/1295558135 >> 172.21.15.103:0/1295558135 conn(0x7fd5980bc9d0 msgr2=0x7fd5980bcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.802+0000 7fd5a06ee640 1 -- 172.21.15.103:0/1295558135 shutdown_connections 2024-04-25T10:35:28.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.802+0000 7fd5a06ee640 1 -- 172.21.15.103:0/1295558135 wait complete. 2024-04-25T10:35:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.803+0000 7fd5a06ee640 1 Processor -- start 2024-04-25T10:35:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.803+0000 7fd5a06ee640 1 -- start start 2024-04-25T10:35:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd5a06ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd584004800 0x7fd5981e2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd5a06ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd598140600 0x7fd59813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd5a06ee640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5981e2e60 0x7fd59813e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd5a06ee640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd59814d680 con 0x7fd598140600 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd5a06ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd5980a1e80 con 0x7fd584004800 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd5a06ee640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fd59814d800 con 0x7fd5981e2e60 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59dc89640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd598140600 0x7fd59813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59dc89640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd598140600 0x7fd59813dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50896/0 (socket says 172.21.15.103:50896) 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59dc89640 1 -- 172.21.15.103:0/3093658177 learned_addr learned my addr 172.21.15.103:0/3093658177 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59e48a640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd584004800 0x7fd5981e2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59ec8b640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5981e2e60 0x7fd59813e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59dc89640 1 -- 172.21.15.103:0/3093658177 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5981e2e60 msgr2=0x7fd59813e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59dc89640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5981e2e60 0x7fd59813e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59dc89640 1 -- 172.21.15.103:0/3093658177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd584004800 msgr2=0x7fd5981e2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59dc89640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd584004800 0x7fd5981e2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.804+0000 7fd59dc89640 1 -- 172.21.15.103:0/3093658177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd598140ae0 con 0x7fd598140600 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.805+0000 7fd59dc89640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd598140600 0x7fd59813dcc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd588001970 tx=0x7fd5980733c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.805+0000 7fd58effd640 1 -- 172.21.15.103:0/3093658177 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588001630 con 0x7fd598140600 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.805+0000 7fd58effd640 1 -- 172.21.15.103:0/3093658177 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588042070 con 0x7fd598140600 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.805+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd598149140 con 0x7fd598140600 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.805+0000 7fd58effd640 1 -- 172.21.15.103:0/3093658177 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588007270 con 0x7fd598140600 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.805+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5981e2960 con 0x7fd598140600 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.806+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59806a130 con 0x7fd598140600 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.806+0000 7fd58effd640 1 -- 172.21.15.103:0/3093658177 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd588007410 con 0x7fd598140600 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.807+0000 7fd58effd640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd57c0744b0 0x7fd57c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.807+0000 7fd59e48a640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd57c0744b0 0x7fd57c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.807+0000 7fd58effd640 1 -- 172.21.15.103:0/3093658177 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fd5880b5270 con 0x7fd598140600 2024-04-25T10:35:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.808+0000 7fd59e48a640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd57c0744b0 0x7fd57c0769c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd59806ea80 tx=0x7fd594009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.812+0000 7fd58effd640 1 -- 172.21.15.103:0/3093658177 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd58807f9f0 con 0x7fd598140600 2024-04-25T10:35:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.986+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd5980bbe80 con 0x7fd57c0744b0 2024-04-25T10:35:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.986+0000 7fd58effd640 1 -- 172.21.15.103:0/3093658177 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd5980bbe80 con 0x7fd57c0744b0 2024-04-25T10:35:28.988 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T10:35:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd57c0744b0 msgr2=0x7fd57c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd57c0744b0 0x7fd57c0769c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd59806ea80 tx=0x7fd594009190 comp rx=0 tx=0).stop 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd598140600 msgr2=0x7fd59813dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd598140600 0x7fd59813dcc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd588001970 tx=0x7fd5980733c0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 shutdown_connections 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd57c0744b0 0x7fd57c0769c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5981e2e60 0x7fd59813e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd598140600 0x7fd59813dcc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 --2- 172.21.15.103:0/3093658177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd584004800 0x7fd5981e2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.988+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 >> 172.21.15.103:0/3093658177 conn(0x7fd5980bc9d0 msgr2=0x7fd59806d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.989+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 shutdown_connections 2024-04-25T10:35:28.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:28.989+0000 7fd5a06ee640 1 -- 172.21.15.103:0/3093658177 wait complete. 2024-04-25T10:35:29.001 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T10:35:29.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:35:29.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.110+0000 7f6064251640 1 Processor -- start 2024-04-25T10:35:29.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.111+0000 7f6064251640 1 -- start start 2024-04-25T10:35:29.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6064251640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f605c072290 0x7f605c143730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6064251640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f605c06dc20 0x7f605c06e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6064251640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c071ad0 con 0x7f605c070710 2024-04-25T10:35:29.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6064251640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f605c06e940 con 0x7f605c072290 2024-04-25T10:35:29.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6064251640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f605c070b20 con 0x7f605c06dc20 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f60617ec640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f605c070710 0x7f605c0b8370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48318/0 (socket says 172.21.15.103:48318) 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f60617ec640 1 -- 172.21.15.103:0/1067255359 learned_addr learned my addr 172.21.15.103:0/1067255359 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f60627ee640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f605c06dc20 0x7f605c06e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6061fed640 1 --2- 172.21.15.103:0/1067255359 >> v2:172.21.15.132:3300/0 conn(0x7f605c072290 0x7f605c143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982283753 0 0) 0x7f605c071ad0 con 0x7f605c070710 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6048003520 con 0x7f605c070710 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 332178637 0 0) 0x7f6048003520 con 0x7f605c070710 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f605c06dc20 msgr2=0x7f605c06e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f605c06dc20 0x7f605c06e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 >> v2:172.21.15.132:3300/0 conn(0x7f605c072290 msgr2=0x7f605c143730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 --2- 172.21.15.103:0/1067255359 >> v2:172.21.15.132:3300/0 conn(0x7f605c072290 0x7f605c143730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c06e570 con 0x7f605c070710 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f604c001690 con 0x7f605c070710 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 >> v1:172.21.15.103:6789/0 conn(0x7f605c070710 legacy=0x7f605c0b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60480039b0 0x7f6048003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f605c06dc20 0x7f6048004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6048004d40 0x7f6048005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f605c06e940 con 0x7f6048004d40 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f605c070b20 con 0x7f60480039b0 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.112+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f604800baf0 con 0x7f605c06dc20 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f60627ee640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6048004d40 0x7f6048005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f6061fed640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60480039b0 0x7f6048003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f60617ec640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f605c06dc20 0x7f6048004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f60627ee640 1 -- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f605c06dc20 msgr2=0x7f6048004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f60627ee640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f605c06dc20 0x7f6048004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f60627ee640 1 -- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60480039b0 msgr2=0x7f6048003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f60627ee640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60480039b0 0x7f6048003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f60627ee640 1 -- 172.21.15.103:0/1067255359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6048003520 con 0x7f6048004d40 2024-04-25T10:35:29.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.113+0000 7f60627ee640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6048004d40 0x7f6048005150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6054009a90 tx=0x7f6048005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475e4094dc4bf83a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054036070 con 0x7f6048004d40 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6054031400 con 0x7f6048004d40 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6060feb640 1 -- 172.21.15.103:0/1067255359 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054009690 con 0x7f6048004d40 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6064251640 1 -- 172.21.15.103:0/1067255359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6048004d40 msgr2=0x7f6048005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6064251640 1 --2- 172.21.15.103:0/1067255359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6048004d40 0x7f6048005150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6054009a90 tx=0x7f6048005830 comp rx=0 tx=0).stop 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f60627ee640 1 -- 172.21.15.103:0/1067255359 reap_dead start 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6064251640 1 -- 172.21.15.103:0/1067255359 shutdown_connections 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6064251640 1 -- 172.21.15.103:0/1067255359 >> 172.21.15.103:0/1067255359 conn(0x7f605c0b9460 msgr2=0x7f605c0b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6064251640 1 -- 172.21.15.103:0/1067255359 shutdown_connections 2024-04-25T10:35:29.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.114+0000 7f6064251640 1 -- 172.21.15.103:0/1067255359 wait complete. 2024-04-25T10:35:29.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.116+0000 7f6064251640 1 Processor -- start 2024-04-25T10:35:29.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.116+0000 7f6064251640 1 -- start start 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f6064251640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6048004d40 0x7f605c0a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f6064251640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c0a2020 0x7f605c13a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f6064251640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f605c09fbd0 0x7f605c13abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f6064251640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f605c06e3c0 con 0x7f605c09fbd0 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f6064251640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f605c06e240 con 0x7f605c0a2020 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f6064251640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f605c151d60 con 0x7f6048004d40 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60627ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f605c09fbd0 0x7f605c13abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60627ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f605c09fbd0 0x7f605c13abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50908/0 (socket says 172.21.15.103:50908) 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60627ee640 1 -- 172.21.15.103:0/193085230 learned_addr learned my addr 172.21.15.103:0/193085230 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60617ec640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c0a2020 0x7f605c13a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f6061fed640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6048004d40 0x7f605c0a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60627ee640 1 -- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6048004d40 msgr2=0x7f605c0a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60627ee640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6048004d40 0x7f605c0a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60627ee640 1 -- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c0a2020 msgr2=0x7f605c13a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60627ee640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c0a2020 0x7f605c13a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.117+0000 7f60627ee640 1 -- 172.21.15.103:0/193085230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c1dff20 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.118+0000 7f60627ee640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f605c09fbd0 0x7f605c13abe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f605402ab70 tx=0x7f6054004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.118+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054036040 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.118+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6054041070 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.118+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c1df440 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.118+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054009690 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.118+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c1dfa00 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.119+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f605c06a130 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.119+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f6054004250 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.120+0000 7f60527fc640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f60400744e0 0x7f60400769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.120+0000 7f6061fed640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f60400744e0 0x7f60400769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.120+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f60540b4cc0 con 0x7f605c09fbd0 2024-04-25T10:35:29.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.120+0000 7f60527fc640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f604007c900 0x7f604007edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.120+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 --> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f605403de50 con 0x7f604007c900 2024-04-25T10:35:29.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.120+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f60540b9030 con 0x7f605c09fbd0 2024-04-25T10:35:29.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.120+0000 7f6061fed640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f60400744e0 0x7f60400769f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6058007130 tx=0x7f605800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.120+0000 7f60617ec640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f604007c900 0x7f604007edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.121+0000 7f60617ec640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f604007c900 0x7f604007edd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.122+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 <== osd.4 v2:172.21.15.132:6808/1740285832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f605403de50 con 0x7f604007c900 2024-04-25T10:35:29.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.135+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 --> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f605c0b38d0 con 0x7f604007c900 2024-04-25T10:35:29.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.135+0000 7f60527fc640 1 -- 172.21.15.103:0/193085230 <== osd.4 v2:172.21.15.132:6808/1740285832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f605c0b38d0 con 0x7f604007c900 2024-04-25T10:35:29.137 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:35:29.137 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:35:29.137 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:35:29.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f604007c900 msgr2=0x7f604007edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.132:6808/1740285832,v1:172.21.15.132:6809/1740285832] conn(0x7f604007c900 0x7f604007edd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f60400744e0 msgr2=0x7f60400769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f60400744e0 0x7f60400769f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6058007130 tx=0x7f605800b040 comp rx=0 tx=0).stop 2024-04-25T10:35:29.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f605c09fbd0 msgr2=0x7f605c13abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 --2- 172.21.15.103:0/193085230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f605c09fbd0 0x7f605c13abe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f605402ab70 tx=0x7f6054004730 comp rx=0 tx=0).stop 2024-04-25T10:35:29.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f60627ee640 1 -- 172.21.15.103:0/193085230 reap_dead start 2024-04-25T10:35:29.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 shutdown_connections 2024-04-25T10:35:29.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 >> 172.21.15.103:0/193085230 conn(0x7f605c0b9460 msgr2=0x7f605c0b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:29.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 shutdown_connections 2024-04-25T10:35:29.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.136+0000 7f6064251640 1 -- 172.21.15.103:0/193085230 wait complete. 2024-04-25T10:35:29.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T10:35:29.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.255+0000 7fa0225ee640 1 Processor -- start 2024-04-25T10:35:29.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.255+0000 7fa0225ee640 1 -- start start 2024-04-25T10:35:29.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa0225ee640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa01c0b3060 0x7fa01c0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa0225ee640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa01c0b3610 con 0x7fa01c0a19c0 2024-04-25T10:35:29.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa0225ee640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa01c0b38f0 con 0x7fa01c1410a0 2024-04-25T10:35:29.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa0225ee640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa01c0a1dd0 con 0x7fa01c0b3060 2024-04-25T10:35:29.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa01bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa01c0b3060 0x7fa01c0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa01bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa01c0b3060 0x7fa01c0b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50920/0 (socket says 172.21.15.103:50920) 2024-04-25T10:35:29.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa01bfff640 1 -- 172.21.15.103:0/1190136499 learned_addr learned my addr 172.21.15.103:0/1190136499 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:29.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa01b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa01c0a19c0 0x7fa01c071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48320/0 (socket says 172.21.15.103:48320) 2024-04-25T10:35:29.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa01bfff640 1 -- 172.21.15.103:0/1190136499 >> v1:172.21.15.132:6789/0 conn(0x7fa01c1410a0 legacy=0x7fa01c1414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa01bfff640 1 -- 172.21.15.103:0/1190136499 >> v1:172.21.15.103:6789/0 conn(0x7fa01c0a19c0 legacy=0x7fa01c071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.256+0000 7fa01bfff640 1 -- 172.21.15.103:0/1190136499 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01c071850 con 0x7fa01c0b3060 2024-04-25T10:35:29.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.257+0000 7fa01bfff640 1 --2- 172.21.15.103:0/1190136499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c0b3060 0x7fa01c0b1c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009870 tx=0x7fa00c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad590e3b2e090d0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.257+0000 7fa01affd640 1 -- 172.21.15.103:0/1190136499 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00c037070 con 0x7fa01c0b3060 2024-04-25T10:35:29.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.257+0000 7fa01affd640 1 -- 172.21.15.103:0/1190136499 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c02ae50 con 0x7fa01c0b3060 2024-04-25T10:35:29.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.257+0000 7fa01affd640 1 -- 172.21.15.103:0/1190136499 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00c032860 con 0x7fa01c0b3060 2024-04-25T10:35:29.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.258+0000 7fa0225ee640 1 -- 172.21.15.103:0/1190136499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c0b3060 msgr2=0x7fa01c0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.258+0000 7fa0225ee640 1 --2- 172.21.15.103:0/1190136499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c0b3060 0x7fa01c0b1c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009870 tx=0x7fa00c02a300 comp rx=0 tx=0).stop 2024-04-25T10:35:29.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.258+0000 7fa0225ee640 1 -- 172.21.15.103:0/1190136499 shutdown_connections 2024-04-25T10:35:29.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.258+0000 7fa0225ee640 1 --2- 172.21.15.103:0/1190136499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c0b3060 0x7fa01c0b1c20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.258+0000 7fa0225ee640 1 -- 172.21.15.103:0/1190136499 >> 172.21.15.103:0/1190136499 conn(0x7fa01c0bc960 msgr2=0x7fa01c0bcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:29.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.258+0000 7fa0225ee640 1 -- 172.21.15.103:0/1190136499 shutdown_connections 2024-04-25T10:35:29.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.258+0000 7fa0225ee640 1 -- 172.21.15.103:0/1190136499 wait complete. 2024-04-25T10:35:29.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.259+0000 7fa0225ee640 1 Processor -- start 2024-04-25T10:35:29.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.260+0000 7fa0225ee640 1 -- start start 2024-04-25T10:35:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa0225ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0a19c0 0x7fa01c142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa0225ee640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa01c0b3060 0x7fa01c0b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa0225ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c1410a0 0x7fa01c143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa0225ee640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c152e40 con 0x7fa01c1410a0 2024-04-25T10:35:29.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa0225ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa01c0a1f50 con 0x7fa01c0a19c0 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa0225ee640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa01c152fc0 con 0x7fa01c0b3060 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c1410a0 0x7fa01c143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c1410a0 0x7fa01c143cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50934/0 (socket says 172.21.15.103:50934) 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 -- 172.21.15.103:0/535436204 learned_addr learned my addr 172.21.15.103:0/535436204 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa01bfff640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0a19c0 0x7fa01c142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa01b7fe640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa01c0b3060 0x7fa01c0b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 -- 172.21.15.103:0/535436204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa01c0b3060 msgr2=0x7fa01c0b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa01c0b3060 0x7fa01c0b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 -- 172.21.15.103:0/535436204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0a19c0 msgr2=0x7fa01c142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0a19c0 0x7fa01c142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 -- 172.21.15.103:0/535436204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01c0b5900 con 0x7fa01c1410a0 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa020b8b640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c1410a0 0x7fa01c143cf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c760 tx=0x7fa01400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa018ff9640 1 -- 172.21.15.103:0/535436204 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014003b70 con 0x7fa01c1410a0 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa018ff9640 1 -- 172.21.15.103:0/535436204 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa014003d10 con 0x7fa01c1410a0 2024-04-25T10:35:29.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01c1445c0 con 0x7fa01c1410a0 2024-04-25T10:35:29.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa018ff9640 1 -- 172.21.15.103:0/535436204 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01400aa90 con 0x7fa01c1410a0 2024-04-25T10:35:29.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.261+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa01c0b5b10 con 0x7fa01c1410a0 2024-04-25T10:35:29.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.262+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa01c06a130 con 0x7fa01c1410a0 2024-04-25T10:35:29.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.263+0000 7fa018ff9640 1 -- 172.21.15.103:0/535436204 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa01400ac30 con 0x7fa01c1410a0 2024-04-25T10:35:29.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.263+0000 7fa018ff9640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa0080744b0 0x7fa0080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.263+0000 7fa018ff9640 1 -- 172.21.15.103:0/535436204 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fa014095030 con 0x7fa01c1410a0 2024-04-25T10:35:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.263+0000 7fa01bfff640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa0080744b0 0x7fa0080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.264+0000 7fa01bfff640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa0080744b0 0x7fa0080769c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa00c034000 tx=0x7fa00c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.268+0000 7fa018ff9640 1 -- 172.21.15.103:0/535436204 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa01405f7b0 con 0x7fa01c1410a0 2024-04-25T10:35:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.446+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa01c13e130 con 0x7fa0080744b0 2024-04-25T10:35:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.446+0000 7fa018ff9640 1 -- 172.21.15.103:0/535436204 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa01c13e130 con 0x7fa0080744b0 2024-04-25T10:35:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T10:35:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa0080744b0 msgr2=0x7fa0080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa0080744b0 0x7fa0080769c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa00c034000 tx=0x7fa00c02e000 comp rx=0 tx=0).stop 2024-04-25T10:35:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c1410a0 msgr2=0x7fa01c143cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c1410a0 0x7fa01c143cf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa01400c760 tx=0x7fa01400cc20 comp rx=0 tx=0).stop 2024-04-25T10:35:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 shutdown_connections 2024-04-25T10:35:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa0080744b0 0x7fa0080769c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa01c1410a0 0x7fa01c143cf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa01c0b3060 0x7fa01c0b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 --2- 172.21.15.103:0/535436204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa01c0a19c0 0x7fa01c142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.448+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 >> 172.21.15.103:0/535436204 conn(0x7fa01c0bc960 msgr2=0x7fa01c13f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.449+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 shutdown_connections 2024-04-25T10:35:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.449+0000 7fa0225ee640 1 -- 172.21.15.103:0/535436204 wait complete. 2024-04-25T10:35:29.461 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T10:35:29.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:35:29.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.573+0000 7f663516b640 1 Processor -- start 2024-04-25T10:35:29.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.573+0000 7f663516b640 1 -- start start 2024-04-25T10:35:29.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.574+0000 7f663516b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66300b6f10 0x7f66301435d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f663516b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66300739d0 con 0x7f6630143b10 2024-04-25T10:35:29.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f663516b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6630073cb0 con 0x7f663014cc10 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f663516b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f6630073f90 con 0x7f66300b6f10 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f6627fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6630143b10 0x7f663006c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48326/0 (socket says 172.21.15.103:48326) 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f662ed9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66300b6f10 0x7f66301435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f6627fff640 1 -- 172.21.15.103:0/2043811828 learned_addr learned my addr 172.21.15.103:0/2043811828 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f662e59c640 1 -- 172.21.15.103:0/2043811828 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870837444 0 0) 0x7f66300739d0 con 0x7f6630143b10 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f662e59c640 1 -- 172.21.15.103:0/2043811828 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f661c003520 con 0x7f6630143b10 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f662ed9d640 1 -- 172.21.15.103:0/2043811828 >> v1:172.21.15.132:6789/0 conn(0x7f663014cc10 legacy=0x7f6630153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f662ed9d640 1 -- 172.21.15.103:0/2043811828 >> v1:172.21.15.103:6789/0 conn(0x7f6630143b10 legacy=0x7f663006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.575+0000 7f662ed9d640 1 -- 172.21.15.103:0/2043811828 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66300b7320 con 0x7f66300b6f10 2024-04-25T10:35:29.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.576+0000 7f662ed9d640 1 --2- 172.21.15.103:0/2043811828 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66300b6f10 0x7f66301435d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f66200097d0 tx=0x7f662002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8912e8a44cb701c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.576+0000 7f662e59c640 1 -- 172.21.15.103:0/2043811828 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6620037070 con 0x7f66300b6f10 2024-04-25T10:35:29.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.576+0000 7f662e59c640 1 -- 172.21.15.103:0/2043811828 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6620032440 con 0x7f66300b6f10 2024-04-25T10:35:29.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.576+0000 7f662e59c640 1 -- 172.21.15.103:0/2043811828 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66200327f0 con 0x7f66300b6f10 2024-04-25T10:35:29.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.577+0000 7f663516b640 1 -- 172.21.15.103:0/2043811828 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66300b6f10 msgr2=0x7f66301435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.577+0000 7f663516b640 1 --2- 172.21.15.103:0/2043811828 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66300b6f10 0x7f66301435d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f66200097d0 tx=0x7f662002a180 comp rx=0 tx=0).stop 2024-04-25T10:35:29.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.577+0000 7f663516b640 1 -- 172.21.15.103:0/2043811828 shutdown_connections 2024-04-25T10:35:29.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.577+0000 7f663516b640 1 --2- 172.21.15.103:0/2043811828 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f66300b6f10 0x7f66301435d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.577+0000 7f663516b640 1 -- 172.21.15.103:0/2043811828 >> 172.21.15.103:0/2043811828 conn(0x7f66300b84d0 msgr2=0x7f66300b88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:29.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.577+0000 7f663516b640 1 -- 172.21.15.103:0/2043811828 shutdown_connections 2024-04-25T10:35:29.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.577+0000 7f663516b640 1 -- 172.21.15.103:0/2043811828 wait complete. 2024-04-25T10:35:29.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.578+0000 7f663516b640 1 Processor -- start 2024-04-25T10:35:29.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.579+0000 7f663516b640 1 -- start start 2024-04-25T10:35:29.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.579+0000 7f663516b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66300b6f10 0x7f663014c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.579+0000 7f663516b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6630143b10 0x7f663013ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.579+0000 7f663516b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f663014cc10 0x7f663013f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.579+0000 7f663516b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f663014d1a0 con 0x7f663014cc10 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.579+0000 7f663516b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f663014d020 con 0x7f66300b6f10 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f663516b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f663014d320 con 0x7f6630143b10 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f663014cc10 0x7f663013f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f663014cc10 0x7f663013f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50942/0 (socket says 172.21.15.103:50942) 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 -- 172.21.15.103:0/2723713434 learned_addr learned my addr 172.21.15.103:0/2723713434 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f6627fff640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6630143b10 0x7f663013ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662ed9d640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66300b6f10 0x7f663014c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 -- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6630143b10 msgr2=0x7f663013ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6630143b10 0x7f663013ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 -- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66300b6f10 msgr2=0x7f663014c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66300b6f10 0x7f663014c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 -- 172.21.15.103:0/2723713434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6630146e40 con 0x7f663014cc10 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f662f59e640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f663014cc10 0x7f663013f1b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f662800c6e0 tx=0x7f662800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6628003b70 con 0x7f663014cc10 2024-04-25T10:35:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6628003d30 con 0x7f663014cc10 2024-04-25T10:35:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6628005310 con 0x7f663014cc10 2024-04-25T10:35:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66300b4f80 con 0x7f663014cc10 2024-04-25T10:35:29.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.580+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66301456c0 con 0x7f663014cc10 2024-04-25T10:35:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.581+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f663006a130 con 0x7f663014cc10 2024-04-25T10:35:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.582+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f66280054b0 con 0x7f663014cc10 2024-04-25T10:35:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.582+0000 7f66277fe640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f66100744e0 0x7f66100769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.582+0000 7f662ed9d640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f66100744e0 0x7f66100769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.582+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f6628094f00 con 0x7f663014cc10 2024-04-25T10:35:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.582+0000 7f66277fe640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7f661007c900 0x7f661007edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.582+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f662800de50 con 0x7f661007c900 2024-04-25T10:35:29.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.582+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6628097600 con 0x7f663014cc10 2024-04-25T10:35:29.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.583+0000 7f6627fff640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7f661007c900 0x7f661007edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.583+0000 7f662ed9d640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f66100744e0 0x7f66100769f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6620034000 tx=0x7f662002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.583+0000 7f6627fff640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7f661007c900 0x7f661007edd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.584+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 <== osd.5 v2:172.21.15.132:6824/2888495984 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f662800de50 con 0x7f661007c900 2024-04-25T10:35:29.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.597+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 --> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6630147f50 con 0x7f661007c900 2024-04-25T10:35:29.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.597+0000 7f66277fe640 1 -- 172.21.15.103:0/2723713434 <== osd.5 v2:172.21.15.132:6824/2888495984 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6630147f50 con 0x7f661007c900 2024-04-25T10:35:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:35:29.599 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:35:29.599 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:35:29.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7f661007c900 msgr2=0x7f661007edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.132:6824/2888495984,v1:172.21.15.132:6825/2888495984] conn(0x7f661007c900 0x7f661007edd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f66100744e0 msgr2=0x7f66100769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f66100744e0 0x7f66100769f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6620034000 tx=0x7f662002e000 comp rx=0 tx=0).stop 2024-04-25T10:35:29.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f663014cc10 msgr2=0x7f663013f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 --2- 172.21.15.103:0/2723713434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f663014cc10 0x7f663013f1b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f662800c6e0 tx=0x7f662800cba0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f662f59e640 1 -- 172.21.15.103:0/2723713434 reap_dead start 2024-04-25T10:35:29.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 shutdown_connections 2024-04-25T10:35:29.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 >> 172.21.15.103:0/2723713434 conn(0x7f66300b84d0 msgr2=0x7f6630142c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:29.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 shutdown_connections 2024-04-25T10:35:29.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.598+0000 7f663516b640 1 -- 172.21.15.103:0/2723713434 wait complete. 2024-04-25T10:35:29.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T10:35:29.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.718+0000 7fc983e9f640 1 Processor -- start 2024-04-25T10:35:29.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.718+0000 7fc983e9f640 1 -- start start 2024-04-25T10:35:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc983e9f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc97c0b3fc0 0x7fc97c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc983e9f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc97c0b4cc0 con 0x7fc97c06c7a0 2024-04-25T10:35:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc983e9f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc97c0b4fa0 con 0x7fc97c0b6420 2024-04-25T10:35:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc983e9f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc97c0b43d0 con 0x7fc97c0b3fc0 2024-04-25T10:35:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc981c3b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc97c0b3fc0 0x7fc97c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc98143a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc97c06c7a0 0x7fc97c141410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48340/0 (socket says 172.21.15.103:48340) 2024-04-25T10:35:29.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc98143a640 1 -- 172.21.15.103:0/2933005560 learned_addr learned my addr 172.21.15.103:0/2933005560 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:29.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc981c3b640 1 -- 172.21.15.103:0/2933005560 >> v1:172.21.15.132:6789/0 conn(0x7fc97c0b6420 legacy=0x7fc97c151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:29.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc981c3b640 1 -- 172.21.15.103:0/2933005560 >> v1:172.21.15.103:6789/0 conn(0x7fc97c06c7a0 legacy=0x7fc97c141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc981c3b640 1 -- 172.21.15.103:0/2933005560 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c06cbb0 con 0x7fc97c0b3fc0 2024-04-25T10:35:29.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.719+0000 7fc980c39640 1 -- 172.21.15.103:0/2933005560 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456226753 0 0) 0x7fc97c0b4cc0 con 0x7fc97c06c7a0 2024-04-25T10:35:29.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.720+0000 7fc981c3b640 1 --2- 172.21.15.103:0/2933005560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c0b3fc0 0x7fc97c0b8aa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0b4550 tx=0x7fc97802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68293015af8499cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.720+0000 7fc980c39640 1 -- 172.21.15.103:0/2933005560 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978037070 con 0x7fc97c0b3fc0 2024-04-25T10:35:29.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.720+0000 7fc980c39640 1 -- 172.21.15.103:0/2933005560 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc978032440 con 0x7fc97c0b3fc0 2024-04-25T10:35:29.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.720+0000 7fc980c39640 1 -- 172.21.15.103:0/2933005560 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978032810 con 0x7fc97c0b3fc0 2024-04-25T10:35:29.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.721+0000 7fc983e9f640 1 -- 172.21.15.103:0/2933005560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c0b3fc0 msgr2=0x7fc97c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.721+0000 7fc983e9f640 1 --2- 172.21.15.103:0/2933005560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c0b3fc0 0x7fc97c0b8aa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0b4550 tx=0x7fc97802a1c0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.721+0000 7fc983e9f640 1 -- 172.21.15.103:0/2933005560 shutdown_connections 2024-04-25T10:35:29.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.721+0000 7fc983e9f640 1 --2- 172.21.15.103:0/2933005560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c0b3fc0 0x7fc97c0b8aa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.721+0000 7fc983e9f640 1 -- 172.21.15.103:0/2933005560 >> 172.21.15.103:0/2933005560 conn(0x7fc97c0bc9a0 msgr2=0x7fc97c0bcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:29.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.721+0000 7fc983e9f640 1 -- 172.21.15.103:0/2933005560 shutdown_connections 2024-04-25T10:35:29.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.721+0000 7fc983e9f640 1 -- 172.21.15.103:0/2933005560 wait complete. 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.723+0000 7fc983e9f640 1 Processor -- start 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.723+0000 7fc983e9f640 1 -- start start 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.723+0000 7fc983e9f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c06c7a0 0x7fc97c1405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc983e9f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc97c0b3fc0 0x7fc97c1d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc983e9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc97c0b6420 0x7fc97c139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc983e9f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c141b20 con 0x7fc97c06c7a0 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc983e9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c0b6830 con 0x7fc97c0b6420 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc983e9f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fc97c1d1070 con 0x7fc97c0b3fc0 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c06c7a0 0x7fc97c1405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c06c7a0 0x7fc97c1405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50970/0 (socket says 172.21.15.103:50970) 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 -- 172.21.15.103:0/2402564519 learned_addr learned my addr 172.21.15.103:0/2402564519 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:29.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc98143a640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc97c0b3fc0 0x7fc97c1d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc98243c640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc97c0b6420 0x7fc97c139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 -- 172.21.15.103:0/2402564519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc97c0b3fc0 msgr2=0x7fc97c1d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc97c0b3fc0 0x7fc97c1d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 -- 172.21.15.103:0/2402564519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc97c0b6420 msgr2=0x7fc97c139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc97c0b6420 0x7fc97c139a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 -- 172.21.15.103:0/2402564519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c1d0ba0 con 0x7fc97c06c7a0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc981c3b640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c06c7a0 0x7fc97c1405c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc978009890 tx=0x7fc9780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc9727fc640 1 -- 172.21.15.103:0/2402564519 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978037040 con 0x7fc97c06c7a0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc9727fc640 1 -- 172.21.15.103:0/2402564519 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc978004230 con 0x7fc97c06c7a0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97c1d1b90 con 0x7fc97c06c7a0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc9727fc640 1 -- 172.21.15.103:0/2402564519 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978032e20 con 0x7fc97c06c7a0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.724+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97c1cfb00 con 0x7fc97c06c7a0 2024-04-25T10:35:29.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.725+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97c06a130 con 0x7fc97c06c7a0 2024-04-25T10:35:29.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.726+0000 7fc9727fc640 1 -- 172.21.15.103:0/2402564519 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fc978030770 con 0x7fc97c06c7a0 2024-04-25T10:35:29.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.726+0000 7fc9727fc640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:29.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.726+0000 7fc98143a640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:29.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.726+0000 7fc9727fc640 1 -- 172.21.15.103:0/2402564519 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fc9780b6390 con 0x7fc97c06c7a0 2024-04-25T10:35:29.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.727+0000 7fc98143a640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc9600744b0 0x7fc9600769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc97c148800 tx=0x7fc96c007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:29.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.731+0000 7fc9727fc640 1 -- 172.21.15.103:0/2402564519 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc978080a80 con 0x7fc97c06c7a0 2024-04-25T10:35:29.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.907+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fc97c0b7ee0 con 0x7fc9600744b0 2024-04-25T10:35:29.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.907+0000 7fc9727fc640 1 -- 172.21.15.103:0/2402564519 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc97c0b7ee0 con 0x7fc9600744b0 2024-04-25T10:35:29.909 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T10:35:29.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc9600744b0 msgr2=0x7fc9600769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc9600744b0 0x7fc9600769c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc97c148800 tx=0x7fc96c007c00 comp rx=0 tx=0).stop 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c06c7a0 msgr2=0x7fc97c1405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c06c7a0 0x7fc97c1405c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc978009890 tx=0x7fc9780046c0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 shutdown_connections 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fc9600744b0 0x7fc9600769c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc97c0b6420 0x7fc97c139a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc97c0b3fc0 0x7fc97c1d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 --2- 172.21.15.103:0/2402564519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc97c06c7a0 0x7fc97c1405c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 >> 172.21.15.103:0/2402564519 conn(0x7fc97c0bc9a0 msgr2=0x7fc97c0b6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 shutdown_connections 2024-04-25T10:35:29.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:29.909+0000 7fc983e9f640 1 -- 172.21.15.103:0/2402564519 wait complete. 2024-04-25T10:35:29.922 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T10:35:29.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:35:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.032+0000 7f922ba49640 1 Processor -- start 2024-04-25T10:35:30.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.032+0000 7f922ba49640 1 -- start start 2024-04-25T10:35:30.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f922ba49640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92240b7e10 0x7f922406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f922ba49640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92240b8220 con 0x7f92240ba3c0 2024-04-25T10:35:30.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f922ba49640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92240b84a0 con 0x7f922414cf20 2024-04-25T10:35:30.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f922ba49640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f92240b8a60 con 0x7f92240b7e10 2024-04-25T10:35:30.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f9228fe4640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f92240ba3c0 0x7f9224146850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48350/0 (socket says 172.21.15.103:48350) 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f9228fe4640 1 -- 172.21.15.103:0/3542331746 learned_addr learned my addr 172.21.15.103:0/3542331746 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f92297e5640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92240b7e10 0x7f922406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692303880 0 0) 0x7f9214001110 con 0x7f92240ba3c0 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9210003520 con 0x7f92240ba3c0 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3831074317 0 0) 0x7f9210003520 con 0x7f92240ba3c0 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92240b7e10 msgr2=0x7f922406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f921bfff640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92240b7e10 0x7f922406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 >> v1:172.21.15.132:6789/0 conn(0x7f922414cf20 legacy=0x7f922414d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92240b8780 con 0x7f92240ba3c0 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.033+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7f9214001840 con 0x7f92240ba3c0 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 >> v1:172.21.15.103:6789/0 conn(0x7f92240ba3c0 legacy=0x7f9224146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f921bfff640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92100039e0 0x7f9210003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f921bfff640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92240b7e10 0x7f9210004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f921bfff640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210004d40 0x7f9210005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f92240b8a60 con 0x7f9210004d40 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f921000bb80 con 0x7f92100039e0 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f921000bd80 con 0x7f92240b7e10 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f9229fe6640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210004d40 0x7f9210005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f9228fe4640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92240b7e10 0x7f9210004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f92297e5640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92100039e0 0x7f9210003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f9229fe6640 1 -- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92240b7e10 msgr2=0x7f9210004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f9229fe6640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92240b7e10 0x7f9210004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f9229fe6640 1 -- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92100039e0 msgr2=0x7f9210003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f9229fe6640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92100039e0 0x7f9210003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.034+0000 7f9229fe6640 1 -- 172.21.15.103:0/3542331746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9210003520 con 0x7f9210004d40 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.035+0000 7f9229fe6640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210004d40 0x7f9210005150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f922406de00 tx=0x7f9210005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82feb0643210d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.035+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c001370 con 0x7f9210004d40 2024-04-25T10:35:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.035+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c0052d0 con 0x7f9210004d40 2024-04-25T10:35:30.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.035+0000 7f921bfff640 1 -- 172.21.15.103:0/3542331746 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c02ab90 con 0x7f9210004d40 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.036+0000 7f922ba49640 1 -- 172.21.15.103:0/3542331746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210004d40 msgr2=0x7f9210005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.036+0000 7f922ba49640 1 --2- 172.21.15.103:0/3542331746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9210004d40 0x7f9210005150 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f922406de00 tx=0x7f9210005830 comp rx=0 tx=0).stop 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.036+0000 7f9229fe6640 1 -- 172.21.15.103:0/3542331746 reap_dead start 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.036+0000 7f922ba49640 1 -- 172.21.15.103:0/3542331746 shutdown_connections 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.036+0000 7f922ba49640 1 -- 172.21.15.103:0/3542331746 >> 172.21.15.103:0/3542331746 conn(0x7f92240bf330 msgr2=0x7f92240bb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.036+0000 7f922ba49640 1 -- 172.21.15.103:0/3542331746 shutdown_connections 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.036+0000 7f922ba49640 1 -- 172.21.15.103:0/3542331746 wait complete. 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.037+0000 7f922ba49640 1 Processor -- start 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.037+0000 7f922ba49640 1 -- start start 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f922ba49640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9210004d40 0x7f92241488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f922ba49640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92240b4fc0 0x7f92240bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f922ba49640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92240bdce0 0x7f92240be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f922ba49640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f92241470e0 con 0x7f92240b4fc0 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f922ba49640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9224146f60 con 0x7f92240bdce0 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f922ba49640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f922406d5d0 con 0x7f9210004d40 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f9228fe4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92240b4fc0 0x7f92240bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f9228fe4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92240b4fc0 0x7f92240bd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50996/0 (socket says 172.21.15.103:50996) 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f9228fe4640 1 -- 172.21.15.103:0/2128604350 learned_addr learned my addr 172.21.15.103:0/2128604350 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f9229fe6640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92240bdce0 0x7f92240be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.038+0000 7f92297e5640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9210004d40 0x7f92241488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9228fe4640 1 -- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9210004d40 msgr2=0x7f92241488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9228fe4640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9210004d40 0x7f92241488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9228fe4640 1 -- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92240bdce0 msgr2=0x7f92240be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9228fe4640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92240bdce0 0x7f92240be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9228fe4640 1 -- 172.21.15.103:0/2128604350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92240b44e0 con 0x7f92240b4fc0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9229fe6640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92240bdce0 0x7f92240be0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9228fe4640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92240b4fc0 0x7f92240bd7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92140072c0 tx=0x7f9214007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921400f960 con 0x7f92240b4fc0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9214018070 con 0x7f92240b4fc0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92240b47c0 con 0x7f92240b4fc0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921400fd80 con 0x7f92240b4fc0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.039+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922414c7a0 con 0x7f92240b4fc0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.040+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f922406a130 con 0x7f92240b4fc0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.041+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f921401d460 con 0x7f92240b4fc0 2024-04-25T10:35:30.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.041+0000 7f9219ffb640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f92080744b0 0x7f92080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.041+0000 7f92297e5640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f92080744b0 0x7f92080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.041+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f92140952a0 con 0x7f92240b4fc0 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.041+0000 7f9219ffb640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f920807c8d0 0x7f920807eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.041+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 --> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f920807f470 con 0x7f920807c8d0 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.041+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f921409c050 con 0x7f92240b4fc0 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.042+0000 7f92297e5640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f92080744b0 0x7f92080769c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9220007520 tx=0x7f922000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.042+0000 7f9229fe6640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f920807c8d0 0x7f920807eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.042+0000 7f9229fe6640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f920807c8d0 0x7f920807eda0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.043+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 <== osd.6 v2:172.21.15.132:6800/3517858433 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f920807f470 con 0x7f920807c8d0 2024-04-25T10:35:30.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.056+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 --> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f92240b5400 con 0x7f920807c8d0 2024-04-25T10:35:30.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.056+0000 7f9219ffb640 1 -- 172.21.15.103:0/2128604350 <== osd.6 v2:172.21.15.132:6800/3517858433 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f92240b5400 con 0x7f920807c8d0 2024-04-25T10:35:30.058 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:35:30.058 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:35:30.058 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:35:30.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f920807c8d0 msgr2=0x7f920807eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.132:6800/3517858433,v1:172.21.15.132:6801/3517858433] conn(0x7f920807c8d0 0x7f920807eda0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f92080744b0 msgr2=0x7f92080769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f92080744b0 0x7f92080769c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9220007520 tx=0x7f922000b040 comp rx=0 tx=0).stop 2024-04-25T10:35:30.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92240b4fc0 msgr2=0x7f92240bd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 --2- 172.21.15.103:0/2128604350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92240b4fc0 0x7f92240bd7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f92140072c0 tx=0x7f9214007780 comp rx=0 tx=0).stop 2024-04-25T10:35:30.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f9229fe6640 1 -- 172.21.15.103:0/2128604350 reap_dead start 2024-04-25T10:35:30.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 shutdown_connections 2024-04-25T10:35:30.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 >> 172.21.15.103:0/2128604350 conn(0x7f92240bf330 msgr2=0x7f9224145030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 shutdown_connections 2024-04-25T10:35:30.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.057+0000 7f922ba49640 1 -- 172.21.15.103:0/2128604350 wait complete. 2024-04-25T10:35:30.070 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T10:35:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.177+0000 7f9fe638f640 1 Processor -- start 2024-04-25T10:35:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.177+0000 7f9fe638f640 1 -- start start 2024-04-25T10:35:30.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.178+0000 7f9fe638f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9fe00b5170 0x7f9fe0146450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.178+0000 7f9fe638f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fe0146990 0x7f9fe0150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.178+0000 7f9fe638f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fe0140aa0 con 0x7f9fe0072370 2024-04-25T10:35:30.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.178+0000 7f9fe638f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe0073a90 con 0x7f9fe0146990 2024-04-25T10:35:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.178+0000 7f9fe638f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9fe0073d70 con 0x7f9fe00b5170 2024-04-25T10:35:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.179+0000 7f9fe492c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9fe0146990 0x7f9fe0150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.179+0000 7f9fdffff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9fe0072370 0x7f9fe0140390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48352/0 (socket says 172.21.15.103:48352) 2024-04-25T10:35:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.179+0000 7f9fdffff640 1 -- 172.21.15.103:0/32239293 learned_addr learned my addr 172.21.15.103:0/32239293 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.179+0000 7f9fe492c640 1 -- 172.21.15.103:0/32239293 >> v2:172.21.15.132:3300/0 conn(0x7f9fe00b5170 msgr2=0x7f9fe0146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.179+0000 7f9fe492c640 1 --2- 172.21.15.103:0/32239293 >> v2:172.21.15.132:3300/0 conn(0x7f9fe00b5170 0x7f9fe0146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.179+0000 7f9fe492c640 1 -- 172.21.15.103:0/32239293 >> v1:172.21.15.103:6789/0 conn(0x7f9fe0072370 legacy=0x7f9fe0140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.179+0000 7f9fe492c640 1 -- 172.21.15.103:0/32239293 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe0074050 con 0x7f9fe0146990 2024-04-25T10:35:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.179+0000 7f9fdeffd640 1 -- 172.21.15.103:0/32239293 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032102259 0 0) 0x7f9fe0140aa0 con 0x7f9fe0072370 2024-04-25T10:35:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe492c640 1 --2- 172.21.15.103:0/32239293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0146990 0x7f9fe0150cd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0070090 tx=0x7f9fd802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590a1c066944cf4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fdeffd640 1 -- 172.21.15.103:0/32239293 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8007740 con 0x7f9fe0146990 2024-04-25T10:35:30.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fdeffd640 1 -- 172.21.15.103:0/32239293 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd80078e0 con 0x7f9fe0146990 2024-04-25T10:35:30.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fdeffd640 1 -- 172.21.15.103:0/32239293 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8007cb0 con 0x7f9fe0146990 2024-04-25T10:35:30.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe638f640 1 -- 172.21.15.103:0/32239293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0146990 msgr2=0x7f9fe0150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe638f640 1 --2- 172.21.15.103:0/32239293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0146990 0x7f9fe0150cd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0070090 tx=0x7f9fd802a5f0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe638f640 1 -- 172.21.15.103:0/32239293 shutdown_connections 2024-04-25T10:35:30.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe638f640 1 --2- 172.21.15.103:0/32239293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0146990 0x7f9fe0150cd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe638f640 1 --2- 172.21.15.103:0/32239293 >> v2:172.21.15.132:3300/0 conn(0x7f9fe00b5170 0x7f9fe0146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe638f640 1 -- 172.21.15.103:0/32239293 >> 172.21.15.103:0/32239293 conn(0x7f9fe00b7c10 msgr2=0x7f9fe00ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe638f640 1 -- 172.21.15.103:0/32239293 shutdown_connections 2024-04-25T10:35:30.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.180+0000 7f9fe638f640 1 -- 172.21.15.103:0/32239293 wait complete. 2024-04-25T10:35:30.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.182+0000 7f9fe638f640 1 Processor -- start 2024-04-25T10:35:30.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.182+0000 7f9fe638f640 1 -- start start 2024-04-25T10:35:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fe638f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0072370 0x7f9fe01438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fe638f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fe00b5170 0x7f9fe00b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fe638f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9fe0146990 0x7f9fe00b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fe638f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe0073690 con 0x7f9fe0072370 2024-04-25T10:35:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fe638f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe00b5580 con 0x7f9fe00b5170 2024-04-25T10:35:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fe638f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe0073810 con 0x7f9fe0146990 2024-04-25T10:35:30.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0072370 0x7f9fe01438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0072370 0x7f9fe01438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51010/0 (socket says 172.21.15.103:51010) 2024-04-25T10:35:30.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdffff640 1 -- 172.21.15.103:0/3332327453 learned_addr learned my addr 172.21.15.103:0/3332327453 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:30.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fe492c640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9fe0146990 0x7f9fe00b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdf7fe640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fe00b5170 0x7f9fe00b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdffff640 1 -- 172.21.15.103:0/3332327453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9fe0146990 msgr2=0x7f9fe00b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdffff640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9fe0146990 0x7f9fe00b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdffff640 1 -- 172.21.15.103:0/3332327453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fe00b5170 msgr2=0x7f9fe00b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdffff640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fe00b5170 0x7f9fe00b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.183+0000 7f9fdffff640 1 -- 172.21.15.103:0/3332327453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe009e4f0 con 0x7f9fe0072370 2024-04-25T10:35:30.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.184+0000 7f9fdffff640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0072370 0x7f9fe01438d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c460 tx=0x7f9fd000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.184+0000 7f9fdcff9640 1 -- 172.21.15.103:0/3332327453 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0018070 con 0x7f9fe0072370 2024-04-25T10:35:30.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.184+0000 7f9fdcff9640 1 -- 172.21.15.103:0/3332327453 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd0007500 con 0x7f9fe0072370 2024-04-25T10:35:30.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.184+0000 7f9fdcff9640 1 -- 172.21.15.103:0/3332327453 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0004a20 con 0x7f9fe0072370 2024-04-25T10:35:30.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.184+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe009d5f0 con 0x7f9fe0072370 2024-04-25T10:35:30.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.184+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe009c500 con 0x7f9fe0072370 2024-04-25T10:35:30.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.185+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe006a130 con 0x7f9fe0072370 2024-04-25T10:35:30.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.185+0000 7f9fdcff9640 1 -- 172.21.15.103:0/3332327453 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f9fd001b070 con 0x7f9fe0072370 2024-04-25T10:35:30.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.186+0000 7f9fdcff9640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9fcc0744b0 0x7f9fcc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.186+0000 7f9fdf7fe640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9fcc0744b0 0x7f9fcc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.186+0000 7f9fdcff9640 1 -- 172.21.15.103:0/3332327453 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f9fd00944d0 con 0x7f9fe0072370 2024-04-25T10:35:30.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.186+0000 7f9fdf7fe640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9fcc0744b0 0x7f9fcc0769c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400b810 tx=0x7f9fd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.190+0000 7f9fdcff9640 1 -- 172.21.15.103:0/3332327453 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9fe009e4f0 con 0x7f9fe0072370 2024-04-25T10:35:30.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.366+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f9fe00b8810 con 0x7f9fcc0744b0 2024-04-25T10:35:30.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.367+0000 7f9fdcff9640 1 -- 172.21.15.103:0/3332327453 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9fe00b8810 con 0x7f9fcc0744b0 2024-04-25T10:35:30.369 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9fcc0744b0 msgr2=0x7f9fcc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9fcc0744b0 0x7f9fcc0769c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400b810 tx=0x7f9fd4008040 comp rx=0 tx=0).stop 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0072370 msgr2=0x7f9fe01438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0072370 0x7f9fe01438d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000c460 tx=0x7f9fd000c920 comp rx=0 tx=0).stop 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 shutdown_connections 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f9fcc0744b0 0x7f9fcc0769c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9fe0146990 0x7f9fe00b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9fe00b5170 0x7f9fe00b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 --2- 172.21.15.103:0/3332327453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fe0072370 0x7f9fe01438d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 >> 172.21.15.103:0/3332327453 conn(0x7f9fe00b7c10 msgr2=0x7f9fe00af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 shutdown_connections 2024-04-25T10:35:30.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.369+0000 7f9fe638f640 1 -- 172.21.15.103:0/3332327453 wait complete. 2024-04-25T10:35:30.382 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T10:35:30.382 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:35:30.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.492+0000 7fd6efcd8640 1 Processor -- start 2024-04-25T10:35:30.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.492+0000 7fd6efcd8640 1 -- start start 2024-04-25T10:35:30.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6efcd8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd6e814ca90 0x7fd6e8154e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6efcd8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e8071af0 con 0x7fd6e806dbb0 2024-04-25T10:35:30.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6efcd8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e8072230 con 0x7fd6e80b3940 2024-04-25T10:35:30.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6efcd8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e8072510 con 0x7fd6e814ca90 2024-04-25T10:35:30.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6ed273640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd6e806dbb0 0x7fd6e80b2ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48368/0 (socket says 172.21.15.103:48368) 2024-04-25T10:35:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6ed273640 1 -- 172.21.15.103:0/1645563616 learned_addr learned my addr 172.21.15.103:0/1645563616 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6ee275640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd6e814ca90 0x7fd6e8154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6ee275640 1 -- 172.21.15.103:0/1645563616 >> v1:172.21.15.132:6789/0 conn(0x7fd6e80b3940 legacy=0x7fd6e80b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6ee275640 1 -- 172.21.15.103:0/1645563616 >> v1:172.21.15.103:6789/0 conn(0x7fd6e806dbb0 legacy=0x7fd6e80b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.493+0000 7fd6ee275640 1 -- 172.21.15.103:0/1645563616 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e806e130 con 0x7fd6e814ca90 2024-04-25T10:35:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.494+0000 7fd6ee275640 1 --2- 172.21.15.103:0/1645563616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e814ca90 0x7fd6e8154e10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009d90 tx=0x7fd6e002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a064e003fbe3096 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.494+0000 7fd6eca72640 1 -- 172.21.15.103:0/1645563616 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0031600 con 0x7fd6e814ca90 2024-04-25T10:35:30.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.494+0000 7fd6eca72640 1 -- 172.21.15.103:0/1645563616 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e00317a0 con 0x7fd6e814ca90 2024-04-25T10:35:30.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.494+0000 7fd6eca72640 1 -- 172.21.15.103:0/1645563616 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0031b70 con 0x7fd6e814ca90 2024-04-25T10:35:30.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.495+0000 7fd6efcd8640 1 -- 172.21.15.103:0/1645563616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e814ca90 msgr2=0x7fd6e8154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.495+0000 7fd6efcd8640 1 --2- 172.21.15.103:0/1645563616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e814ca90 0x7fd6e8154e10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0009d90 tx=0x7fd6e002a610 comp rx=0 tx=0).stop 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.495+0000 7fd6efcd8640 1 -- 172.21.15.103:0/1645563616 shutdown_connections 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.495+0000 7fd6efcd8640 1 --2- 172.21.15.103:0/1645563616 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e814ca90 0x7fd6e8154e10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.495+0000 7fd6efcd8640 1 -- 172.21.15.103:0/1645563616 >> 172.21.15.103:0/1645563616 conn(0x7fd6e80b9460 msgr2=0x7fd6e80b9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.495+0000 7fd6efcd8640 1 -- 172.21.15.103:0/1645563616 shutdown_connections 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.495+0000 7fd6efcd8640 1 -- 172.21.15.103:0/1645563616 wait complete. 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.496+0000 7fd6efcd8640 1 Processor -- start 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.497+0000 7fd6efcd8640 1 -- start start 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.497+0000 7fd6efcd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e806dbb0 0x7fd6e80a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.497+0000 7fd6efcd8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6e814ca90 0x7fd6e81dfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.497+0000 7fd6efcd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e8140ac0 0x7fd6e8140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.497+0000 7fd6efcd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e814d020 con 0x7fd6e806dbb0 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.497+0000 7fd6efcd8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e814cea0 con 0x7fd6e8140ac0 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.497+0000 7fd6efcd8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e814d1a0 con 0x7fd6e814ca90 2024-04-25T10:35:30.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e806dbb0 0x7fd6e80a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e806dbb0 0x7fd6e80a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51028/0 (socket says 172.21.15.103:51028) 2024-04-25T10:35:30.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 -- 172.21.15.103:0/938954477 learned_addr learned my addr 172.21.15.103:0/938954477 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:30.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 -- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6e814ca90 msgr2=0x7fd6e81dfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6ee275640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e8140ac0 0x7fd6e8140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6ed273640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6e814ca90 0x7fd6e81dfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6e814ca90 0x7fd6e81dfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 -- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e8140ac0 msgr2=0x7fd6e8140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e8140ac0 0x7fd6e8140ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 -- 172.21.15.103:0/938954477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e80a0c00 con 0x7fd6e806dbb0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6eda74640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e806dbb0 0x7fd6e80a1630 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b410 tx=0x7fd6e400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4015020 con 0x7fd6e806dbb0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e4011830 con 0x7fd6e806dbb0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e81dffd0 con 0x7fd6e806dbb0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4011c20 con 0x7fd6e806dbb0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.498+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e80a03f0 con 0x7fd6e806dbb0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.499+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6e806a130 con 0x7fd6e806dbb0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.500+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fd6e4018020 con 0x7fd6e806dbb0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.500+0000 7fd6de7fc640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd6cc0744b0 0x7fd6cc0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.500+0000 7fd6ed273640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd6cc0744b0 0x7fd6cc0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.500+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fd6e40958e0 con 0x7fd6e806dbb0 2024-04-25T10:35:30.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.501+0000 7fd6de7fc640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7fd6cc07c8d0 0x7fd6cc07eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.501+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6cc07f470 con 0x7fd6cc07c8d0 2024-04-25T10:35:30.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.501+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd6e4095d70 con 0x7fd6e806dbb0 2024-04-25T10:35:30.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.501+0000 7fd6ed273640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd6cc0744b0 0x7fd6cc0769c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80a2c50 tx=0x7fd6d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.501+0000 7fd6ee275640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7fd6cc07c8d0 0x7fd6cc07eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.501+0000 7fd6ee275640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7fd6cc07c8d0 0x7fd6cc07eda0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.502+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 <== osd.7 v2:172.21.15.132:6816/2222857157 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6cc07f470 con 0x7fd6cc07c8d0 2024-04-25T10:35:30.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.515+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 --> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6e814c870 con 0x7fd6cc07c8d0 2024-04-25T10:35:30.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6de7fc640 1 -- 172.21.15.103:0/938954477 <== osd.7 v2:172.21.15.132:6816/2222857157 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6e814c870 con 0x7fd6cc07c8d0 2024-04-25T10:35:30.517 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-04-25T10:35:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:35:30.518 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7fd6cc07c8d0 msgr2=0x7fd6cc07eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.132:6816/2222857157,v1:172.21.15.132:6817/2222857157] conn(0x7fd6cc07c8d0 0x7fd6cc07eda0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd6cc0744b0 msgr2=0x7fd6cc0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fd6cc0744b0 0x7fd6cc0769c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80a2c50 tx=0x7fd6d8009040 comp rx=0 tx=0).stop 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e806dbb0 msgr2=0x7fd6e80a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 --2- 172.21.15.103:0/938954477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6e806dbb0 0x7fd6e80a1630 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b410 tx=0x7fd6e400b8d0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6ee275640 1 -- 172.21.15.103:0/938954477 reap_dead start 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 shutdown_connections 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 >> 172.21.15.103:0/938954477 conn(0x7fd6e80b9460 msgr2=0x7fd6e8141eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.516+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 shutdown_connections 2024-04-25T10:35:30.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.517+0000 7fd6efcd8640 1 -- 172.21.15.103:0/938954477 wait complete. 2024-04-25T10:35:30.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T10:35:30.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.636+0000 7f264bc6e640 1 Processor -- start 2024-04-25T10:35:30.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.637+0000 7f264bc6e640 1 -- start start 2024-04-25T10:35:30.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f264bc6e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26440b8b90 0x7f26440b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f264bc6e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26440b6500 con 0x7f26440b8fa0 2024-04-25T10:35:30.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f264bc6e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2644148350 con 0x7f2644147f40 2024-04-25T10:35:30.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f264bc6e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f2644141bd0 con 0x7f26440b8b90 2024-04-25T10:35:30.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f2649209640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26440b8b90 0x7f26440b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f264a20b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f26440b8fa0 0x7f2644151dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48384/0 (socket says 172.21.15.103:48384) 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f264a20b640 1 -- 172.21.15.103:0/2755919808 learned_addr learned my addr 172.21.15.103:0/2755919808 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f2649209640 1 -- 172.21.15.103:0/2755919808 >> v1:172.21.15.132:6789/0 conn(0x7f2644147f40 legacy=0x7f264406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f2648a08640 1 -- 172.21.15.103:0/2755919808 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1495219247 0 0) 0x7f26440b6500 con 0x7f26440b8fa0 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f2649209640 1 -- 172.21.15.103:0/2755919808 >> v1:172.21.15.103:6789/0 conn(0x7f26440b8fa0 legacy=0x7f2644151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.638+0000 7f2649209640 1 -- 172.21.15.103:0/2755919808 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26440b67c0 con 0x7f26440b8b90 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.639+0000 7f2649209640 1 --2- 172.21.15.103:0/2755919808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f26440b4cc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f26340097a0 tx=0x7f263402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6182357fd105619e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.639+0000 7f2648a08640 1 -- 172.21.15.103:0/2755919808 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634037070 con 0x7f26440b8b90 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.639+0000 7f2648a08640 1 -- 172.21.15.103:0/2755919808 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2634032440 con 0x7f26440b8b90 2024-04-25T10:35:30.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.639+0000 7f2648a08640 1 -- 172.21.15.103:0/2755919808 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634032810 con 0x7f26440b8b90 2024-04-25T10:35:30.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.640+0000 7f264bc6e640 1 -- 172.21.15.103:0/2755919808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 msgr2=0x7f26440b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.640+0000 7f264bc6e640 1 --2- 172.21.15.103:0/2755919808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f26440b4cc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f26340097a0 tx=0x7f263402a230 comp rx=0 tx=0).stop 2024-04-25T10:35:30.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.640+0000 7f264bc6e640 1 -- 172.21.15.103:0/2755919808 shutdown_connections 2024-04-25T10:35:30.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.640+0000 7f264bc6e640 1 --2- 172.21.15.103:0/2755919808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f26440b4cc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.640+0000 7f264bc6e640 1 -- 172.21.15.103:0/2755919808 >> 172.21.15.103:0/2755919808 conn(0x7f26440b94a0 msgr2=0x7f26440b98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.640+0000 7f264bc6e640 1 -- 172.21.15.103:0/2755919808 shutdown_connections 2024-04-25T10:35:30.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.640+0000 7f264bc6e640 1 -- 172.21.15.103:0/2755919808 wait complete. 2024-04-25T10:35:30.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.641+0000 7f264bc6e640 1 Processor -- start 2024-04-25T10:35:30.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.641+0000 7f264bc6e640 1 -- start start 2024-04-25T10:35:30.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.642+0000 7f264bc6e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f2644142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.642+0000 7f264bc6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26440b8fa0 0x7f2644144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.642+0000 7f264bc6e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2644147f40 0x7f26441e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.642+0000 7f264bc6e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2644147450 con 0x7f26440b8b90 2024-04-25T10:35:30.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.642+0000 7f264bc6e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f26440b6e10 con 0x7f26440b8fa0 2024-04-25T10:35:30.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.642+0000 7f264bc6e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f26441475d0 con 0x7f2644147f40 2024-04-25T10:35:30.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f2644142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f2644142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51052/0 (socket says 172.21.15.103:51052) 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 -- 172.21.15.103:0/2434031582 learned_addr learned my addr 172.21.15.103:0/2434031582 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649209640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26440b8fa0 0x7f2644144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f264a20b640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2644147f40 0x7f26441e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 -- 172.21.15.103:0/2434031582 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2644147f40 msgr2=0x7f26441e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2644147f40 0x7f26441e0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 -- 172.21.15.103:0/2434031582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26440b8fa0 msgr2=0x7f2644144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26440b8fa0 0x7f2644144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 -- 172.21.15.103:0/2434031582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2644144ab0 con 0x7f26440b8b90 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f2649a0a640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f2644142140 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f264000c730 tx=0x7f264000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f263a7fc640 1 -- 172.21.15.103:0/2434031582 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640003b70 con 0x7f26440b8b90 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.643+0000 7f263a7fc640 1 -- 172.21.15.103:0/2434031582 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2640003d10 con 0x7f26440b8b90 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.644+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2644142940 con 0x7f26440b8b90 2024-04-25T10:35:30.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.644+0000 7f263a7fc640 1 -- 172.21.15.103:0/2434031582 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264000aa90 con 0x7f26440b8b90 2024-04-25T10:35:30.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.644+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2644142ec0 con 0x7f26440b8b90 2024-04-25T10:35:30.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.645+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2644142680 con 0x7f26440b8b90 2024-04-25T10:35:30.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.645+0000 7f263a7fc640 1 -- 172.21.15.103:0/2434031582 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f264000ac30 con 0x7f26440b8b90 2024-04-25T10:35:30.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.646+0000 7f263a7fc640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26280744b0 0x7f26280769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.646+0000 7f2649209640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26280744b0 0x7f26280769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.646+0000 7f263a7fc640 1 -- 172.21.15.103:0/2434031582 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f2640094fb0 con 0x7f26440b8b90 2024-04-25T10:35:30.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.646+0000 7f2649209640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26280744b0 0x7f26280769c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2634034000 tx=0x7f263402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.650+0000 7f263a7fc640 1 -- 172.21.15.103:0/2434031582 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2644142680 con 0x7f26440b8b90 2024-04-25T10:35:30.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.830+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f26441e0570 con 0x7f26280744b0 2024-04-25T10:35:30.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.830+0000 7f263a7fc640 1 -- 172.21.15.103:0/2434031582 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2634032870 con 0x7f26280744b0 2024-04-25T10:35:30.832 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T10:35:30.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26280744b0 msgr2=0x7f26280769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26280744b0 0x7f26280769c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2634034000 tx=0x7f263402e000 comp rx=0 tx=0).stop 2024-04-25T10:35:30.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 msgr2=0x7f2644142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f2644142140 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f264000c730 tx=0x7f264000cbf0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 shutdown_connections 2024-04-25T10:35:30.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26280744b0 0x7f26280769c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2644147f40 0x7f26441e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26440b8fa0 0x7f2644144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 --2- 172.21.15.103:0/2434031582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26440b8b90 0x7f2644142140 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 >> 172.21.15.103:0/2434031582 conn(0x7f26440b94a0 msgr2=0x7f2644075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 shutdown_connections 2024-04-25T10:35:30.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.832+0000 7f264bc6e640 1 -- 172.21.15.103:0/2434031582 wait complete. 2024-04-25T10:35:30.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:35:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.949+0000 7f450fc29640 1 Processor -- start 2024-04-25T10:35:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.950+0000 7f450fc29640 1 -- start start 2024-04-25T10:35:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450fc29640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f450814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450fc29640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f450814d050 0x7f4508153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450fc29640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f450806e960 con 0x7f45080b2fe0 2024-04-25T10:35:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450fc29640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f450806de80 con 0x7f450814d050 2024-04-25T10:35:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450fc29640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f450806e160 con 0x7f4508071e50 2024-04-25T10:35:30.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450e1c6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f450814d050 0x7f4508153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450d1c4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f450814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450d9c5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f45080b2fe0 0x7f45080b8300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.103:60186/0 (socket says 172.21.15.103:60186) 2024-04-25T10:35:30.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450d1c4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f450814cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:36572/0 (socket says 172.21.15.103:36572) 2024-04-25T10:35:30.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450d9c5640 1 -- 172.21.15.103:0/341605438 learned_addr learned my addr 172.21.15.103:0/341605438 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:30.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450e1c6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f450814d050 0x7f4508153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:59312/0 (socket says 172.21.15.103:59312) 2024-04-25T10:35:30.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450e1c6640 1 -- 172.21.15.103:0/341605438 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 msgr2=0x7f450814cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:30.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450e1c6640 1 --2- 172.21.15.103:0/341605438 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f450814cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450e1c6640 1 -- 172.21.15.103:0/341605438 >> v1:172.21.15.132:6789/0 conn(0x7f45080b2fe0 legacy=0x7f45080b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450e1c6640 1 -- 172.21.15.103:0/341605438 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f450806e440 con 0x7f450814d050 2024-04-25T10:35:30.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.951+0000 7f450d1c4640 1 --2- 172.21.15.103:0/341605438 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f450814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:35:30.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.952+0000 7f450e1c6640 1 --2- 172.21.15.103:0/341605438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 0x7f4508153ea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4500009d90 tx=0x7f450002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c67e7d681abfd428 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.952+0000 7f450c9c3640 1 -- 172.21.15.103:0/341605438 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500007740 con 0x7f450814d050 2024-04-25T10:35:30.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.952+0000 7f450c9c3640 1 -- 172.21.15.103:0/341605438 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45000078e0 con 0x7f450814d050 2024-04-25T10:35:30.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.952+0000 7f450c9c3640 1 -- 172.21.15.103:0/341605438 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500007cb0 con 0x7f450814d050 2024-04-25T10:35:30.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.953+0000 7f450fc29640 1 -- 172.21.15.103:0/341605438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 msgr2=0x7f4508153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.953+0000 7f450fc29640 1 --2- 172.21.15.103:0/341605438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 0x7f4508153ea0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4500009d90 tx=0x7f450002a6f0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.953+0000 7f450fc29640 1 -- 172.21.15.103:0/341605438 shutdown_connections 2024-04-25T10:35:30.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.953+0000 7f450fc29640 1 --2- 172.21.15.103:0/341605438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 0x7f4508153ea0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.953+0000 7f450fc29640 1 --2- 172.21.15.103:0/341605438 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f450814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.953+0000 7f450fc29640 1 -- 172.21.15.103:0/341605438 >> 172.21.15.103:0/341605438 conn(0x7f45080b93f0 msgr2=0x7f45080b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.953+0000 7f450fc29640 1 -- 172.21.15.103:0/341605438 shutdown_connections 2024-04-25T10:35:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.953+0000 7f450fc29640 1 -- 172.21.15.103:0/341605438 wait complete. 2024-04-25T10:35:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.954+0000 7f450fc29640 1 Processor -- start 2024-04-25T10:35:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.954+0000 7f450fc29640 1 -- start start 2024-04-25T10:35:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.955+0000 7f450fc29640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f4508149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.955+0000 7f450fc29640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45080b2fe0 0x7f45081df940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.955+0000 7f450fc29640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 0x7f45081dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.955+0000 7f450fc29640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f45080b3570 con 0x7f45080b2fe0 2024-04-25T10:35:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.955+0000 7f450fc29640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f45080b33f0 con 0x7f450814d050 2024-04-25T10:35:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.955+0000 7f450fc29640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f4508072260 con 0x7f4508071e50 2024-04-25T10:35:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45080b2fe0 0x7f45081df940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45080b2fe0 0x7f45081df940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51066/0 (socket says 172.21.15.103:51066) 2024-04-25T10:35:30.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 -- 172.21.15.103:0/473941620 learned_addr learned my addr 172.21.15.103:0/473941620 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d9c5640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f4508149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450e1c6640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 0x7f45081dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 -- 172.21.15.103:0/473941620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 msgr2=0x7f4508149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f4508149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 -- 172.21.15.103:0/473941620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 msgr2=0x7f45081dfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 0x7f45081dfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:30.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 -- 172.21.15.103:0/473941620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4508149570 con 0x7f45080b2fe0 2024-04-25T10:35:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450d1c4640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45080b2fe0 0x7f45081df940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e930 tx=0x7f44f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f44fe7fc640 1 -- 172.21.15.103:0/473941620 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8017070 con 0x7f45080b2fe0 2024-04-25T10:35:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4508147ef0 con 0x7f45080b2fe0 2024-04-25T10:35:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f44fe7fc640 1 -- 172.21.15.103:0/473941620 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44f800ca00 con 0x7f45080b2fe0 2024-04-25T10:35:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f44fe7fc640 1 -- 172.21.15.103:0/473941620 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f800cdf0 con 0x7f45080b2fe0 2024-04-25T10:35:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.956+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4508148b10 con 0x7f45080b2fe0 2024-04-25T10:35:30.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.957+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450806a130 con 0x7f45080b2fe0 2024-04-25T10:35:30.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.958+0000 7f44fe7fc640 1 -- 172.21.15.103:0/473941620 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f44f801a070 con 0x7f45080b2fe0 2024-04-25T10:35:30.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.958+0000 7f44fe7fc640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f44ec0744b0 0x7f44ec0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:30.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.959+0000 7f450d9c5640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f44ec0744b0 0x7f44ec0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:30.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.959+0000 7f44fe7fc640 1 -- 172.21.15.103:0/473941620 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f44f8094df0 con 0x7f45080b2fe0 2024-04-25T10:35:30.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.959+0000 7f450d9c5640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f44ec0744b0 0x7f44ec0769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4504007fd0 tx=0x7f4504007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:30.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:30.963+0000 7f44fe7fc640 1 -- 172.21.15.103:0/473941620 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f44f805ee10 con 0x7f45080b2fe0 2024-04-25T10:35:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.134+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45081e06e0 con 0x7f44ec0744b0 2024-04-25T10:35:31.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.140+0000 7f44fe7fc640 1 -- 172.21.15.103:0/473941620 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252298 (secure 0 0 0) 0x7f45040013c0 con 0x7f44ec0744b0 2024-04-25T10:35:31.145 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:35:31.147 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:35:31.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f44ec0744b0 msgr2=0x7f44ec0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:31.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f44ec0744b0 0x7f44ec0769c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4504007fd0 tx=0x7f4504007e80 comp rx=0 tx=0).stop 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45080b2fe0 msgr2=0x7f45081df940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45080b2fe0 0x7f45081df940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f44f800e930 tx=0x7f44f800edf0 comp rx=0 tx=0).stop 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 shutdown_connections 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f44ec0744b0 0x7f44ec0769c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f450814d050 0x7f45081dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45080b2fe0 0x7f45081df940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 --2- 172.21.15.103:0/473941620 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4508071e50 0x7f4508149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 >> 172.21.15.103:0/473941620 conn(0x7f45080b93f0 msgr2=0x7f45080b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 shutdown_connections 2024-04-25T10:35:31.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:31.143+0000 7f450fc29640 1 -- 172.21.15.103:0/473941620 wait complete. 2024-04-25T10:35:31.156 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-04-25T10:35:30.516787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":735667,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":281,"num_write_kb":1861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1263,"ondisk_log_size":1263,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219576,"kb_used_data":3448,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755144,"statfs":{"total":773094113280,"available":772869267456,"internally_reserved":0,"allocated":3530752,"data_stored":2185150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,3,17,26],"upper_bound":32},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":142889,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":135,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.928035"},"pg_stats":[{"pgid":"3.3f","version":"23'15","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.062159+0000","last_change":"2024-04-25T10:33:43.181183+0000","last_active":"2024-04-25T10:35:24.062159+0000","last_peered":"2024-04-25T10:35:24.062159+0000","last_clean":"2024-04-25T10:35:24.062159+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:35:24.062159+0000","last_undegraded":"2024-04-25T10:35:24.062159+0000","last_fullsized":"2024-04-25T10:35:24.062159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:44.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.051348+0000","last_change":"2024-04-25T10:33:43.170436+0000","last_active":"2024-04-25T10:35:24.051348+0000","last_peered":"2024-04-25T10:35:24.051348+0000","last_clean":"2024-04-25T10:35:24.051348+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:35:24.051348+0000","last_undegraded":"2024-04-25T10:35:24.051348+0000","last_fullsized":"2024-04-25T10:35:24.051348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'15","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.068154+0000","last_change":"2024-04-25T10:33:43.181271+0000","last_active":"2024-04-25T10:35:24.068154+0000","last_peered":"2024-04-25T10:35:24.068154+0000","last_clean":"2024-04-25T10:35:24.068154+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:35:24.068154+0000","last_undegraded":"2024-04-25T10:35:24.068154+0000","last_fullsized":"2024-04-25T10:35:24.068154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'12","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.066209+0000","last_change":"2024-04-25T10:33:43.176831+0000","last_active":"2024-04-25T10:35:24.066209+0000","last_peered":"2024-04-25T10:35:24.066209+0000","last_clean":"2024-04-25T10:35:24.066209+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:35:24.066209+0000","last_undegraded":"2024-04-25T10:35:24.066209+0000","last_fullsized":"2024-04-25T10:35:24.066209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'15","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.044566+0000","last_change":"2024-04-25T10:33:43.181222+0000","last_active":"2024-04-25T10:35:24.044566+0000","last_peered":"2024-04-25T10:35:24.044566+0000","last_clean":"2024-04-25T10:35:24.044566+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:35:24.044566+0000","last_undegraded":"2024-04-25T10:35:24.044566+0000","last_fullsized":"2024-04-25T10:35:24.044566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:42.544249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.066264+0000","last_change":"2024-04-25T10:33:43.175444+0000","last_active":"2024-04-25T10:35:24.066264+0000","last_peered":"2024-04-25T10:35:24.066264+0000","last_clean":"2024-04-25T10:35:24.066264+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:35:24.066264+0000","last_undegraded":"2024-04-25T10:35:24.066264+0000","last_fullsized":"2024-04-25T10:35:24.066264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'11","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065533+0000","last_change":"2024-04-25T10:33:43.186303+0000","last_active":"2024-04-25T10:35:24.065533+0000","last_peered":"2024-04-25T10:35:24.065533+0000","last_clean":"2024-04-25T10:35:24.065533+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:35:24.065533+0000","last_undegraded":"2024-04-25T10:35:24.065533+0000","last_fullsized":"2024-04-25T10:35:24.065533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.010990+0000","last_change":"2024-04-25T10:33:43.169919+0000","last_active":"2024-04-25T10:35:24.010990+0000","last_peered":"2024-04-25T10:35:24.010990+0000","last_clean":"2024-04-25T10:35:24.010990+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:35:24.010990+0000","last_undegraded":"2024-04-25T10:35:24.010990+0000","last_fullsized":"2024-04-25T10:35:24.010990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'18","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.064402+0000","last_change":"2024-04-25T10:34:24.321277+0000","last_active":"2024-04-25T10:35:24.064402+0000","last_peered":"2024-04-25T10:35:24.064402+0000","last_clean":"2024-04-25T10:35:24.064402+0000","last_became_active":"2024-04-25T10:34:24.320939+0000","last_became_peered":"2024-04-25T10:34:24.320939+0000","last_unstale":"2024-04-25T10:35:24.064402+0000","last_undegraded":"2024-04-25T10:35:24.064402+0000","last_fullsized":"2024-04-25T10:35:24.064402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:35.139675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'26","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.064396+0000","last_change":"2024-04-25T10:33:43.175552+0000","last_active":"2024-04-25T10:35:24.064396+0000","last_peered":"2024-04-25T10:35:24.064396+0000","last_clean":"2024-04-25T10:35:24.064396+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:35:24.064396+0000","last_undegraded":"2024-04-25T10:35:24.064396+0000","last_fullsized":"2024-04-25T10:35:24.064396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'14","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061486+0000","last_change":"2024-04-25T10:33:43.175526+0000","last_active":"2024-04-25T10:35:24.061486+0000","last_peered":"2024-04-25T10:35:24.061486+0000","last_clean":"2024-04-25T10:35:24.061486+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:35:24.061486+0000","last_undegraded":"2024-04-25T10:35:24.061486+0000","last_fullsized":"2024-04-25T10:35:24.061486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'12","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.060520+0000","last_change":"2024-04-25T10:33:43.176506+0000","last_active":"2024-04-25T10:35:24.060520+0000","last_peered":"2024-04-25T10:35:24.060520+0000","last_clean":"2024-04-25T10:35:24.060520+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:35:24.060520+0000","last_undegraded":"2024-04-25T10:35:24.060520+0000","last_fullsized":"2024-04-25T10:35:24.060520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:54.213946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'18","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.062227+0000","last_change":"2024-04-25T10:33:43.178091+0000","last_active":"2024-04-25T10:35:24.062227+0000","last_peered":"2024-04-25T10:35:24.062227+0000","last_clean":"2024-04-25T10:35:24.062227+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:35:24.062227+0000","last_undegraded":"2024-04-25T10:35:24.062227+0000","last_fullsized":"2024-04-25T10:35:24.062227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'20","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065454+0000","last_change":"2024-04-25T10:33:43.173440+0000","last_active":"2024-04-25T10:35:24.065454+0000","last_peered":"2024-04-25T10:35:24.065454+0000","last_clean":"2024-04-25T10:35:24.065454+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:35:24.065454+0000","last_undegraded":"2024-04-25T10:35:24.065454+0000","last_fullsized":"2024-04-25T10:35:24.065454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:29.607252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'17","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.059905+0000","last_change":"2024-04-25T10:33:43.172566+0000","last_active":"2024-04-25T10:35:24.059905+0000","last_peered":"2024-04-25T10:35:24.059905+0000","last_clean":"2024-04-25T10:35:24.059905+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:35:24.059905+0000","last_undegraded":"2024-04-25T10:35:24.059905+0000","last_fullsized":"2024-04-25T10:35:24.059905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'21","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.067045+0000","last_change":"2024-04-25T10:33:43.175162+0000","last_active":"2024-04-25T10:35:24.067045+0000","last_peered":"2024-04-25T10:35:24.067045+0000","last_clean":"2024-04-25T10:35:24.067045+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:35:24.067045+0000","last_undegraded":"2024-04-25T10:35:24.067045+0000","last_fullsized":"2024-04-25T10:35:24.067045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'16","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.063413+0000","last_change":"2024-04-25T10:33:43.183071+0000","last_active":"2024-04-25T10:35:24.063413+0000","last_peered":"2024-04-25T10:35:24.063413+0000","last_clean":"2024-04-25T10:35:24.063413+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:35:24.063413+0000","last_undegraded":"2024-04-25T10:35:24.063413+0000","last_fullsized":"2024-04-25T10:35:24.063413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:14.884446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'26","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.054286+0000","last_change":"2024-04-25T10:33:43.179022+0000","last_active":"2024-04-25T10:35:24.054286+0000","last_peered":"2024-04-25T10:35:24.054286+0000","last_clean":"2024-04-25T10:35:24.054286+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:35:24.054286+0000","last_undegraded":"2024-04-25T10:35:24.054286+0000","last_fullsized":"2024-04-25T10:35:24.054286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'15","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061321+0000","last_change":"2024-04-25T10:33:43.186661+0000","last_active":"2024-04-25T10:35:24.061321+0000","last_peered":"2024-04-25T10:35:24.061321+0000","last_clean":"2024-04-25T10:35:24.061321+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:35:24.061321+0000","last_undegraded":"2024-04-25T10:35:24.061321+0000","last_fullsized":"2024-04-25T10:35:24.061321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:06.758005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'18","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.057078+0000","last_change":"2024-04-25T10:33:43.175801+0000","last_active":"2024-04-25T10:35:24.057078+0000","last_peered":"2024-04-25T10:35:24.057078+0000","last_clean":"2024-04-25T10:35:24.057078+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:35:24.057078+0000","last_undegraded":"2024-04-25T10:35:24.057078+0000","last_fullsized":"2024-04-25T10:35:24.057078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'20","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.067204+0000","last_change":"2024-04-25T10:33:43.183056+0000","last_active":"2024-04-25T10:35:24.067204+0000","last_peered":"2024-04-25T10:35:24.067204+0000","last_clean":"2024-04-25T10:35:24.067204+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:35:24.067204+0000","last_undegraded":"2024-04-25T10:35:24.067204+0000","last_fullsized":"2024-04-25T10:35:24.067204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:48.397573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'19","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065947+0000","last_change":"2024-04-25T10:33:43.180388+0000","last_active":"2024-04-25T10:35:24.065947+0000","last_peered":"2024-04-25T10:35:24.065947+0000","last_clean":"2024-04-25T10:35:24.065947+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:35:24.065947+0000","last_undegraded":"2024-04-25T10:35:24.065947+0000","last_fullsized":"2024-04-25T10:35:24.065947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'19","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061073+0000","last_change":"2024-04-25T10:33:43.162216+0000","last_active":"2024-04-25T10:35:24.061073+0000","last_peered":"2024-04-25T10:35:24.061073+0000","last_clean":"2024-04-25T10:35:24.061073+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:35:24.061073+0000","last_undegraded":"2024-04-25T10:35:24.061073+0000","last_fullsized":"2024-04-25T10:35:24.061073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'15","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065310+0000","last_change":"2024-04-25T10:33:43.183734+0000","last_active":"2024-04-25T10:35:24.065310+0000","last_peered":"2024-04-25T10:35:24.065310+0000","last_clean":"2024-04-25T10:35:24.065310+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:35:24.065310+0000","last_undegraded":"2024-04-25T10:35:24.065310+0000","last_fullsized":"2024-04-25T10:35:24.065310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'11","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.042065+0000","last_change":"2024-04-25T10:34:24.299795+0000","last_active":"2024-04-25T10:35:24.042065+0000","last_peered":"2024-04-25T10:35:24.042065+0000","last_clean":"2024-04-25T10:35:24.042065+0000","last_became_active":"2024-04-25T10:34:24.299359+0000","last_became_peered":"2024-04-25T10:34:24.299359+0000","last_unstale":"2024-04-25T10:35:24.042065+0000","last_undegraded":"2024-04-25T10:35:24.042065+0000","last_fullsized":"2024-04-25T10:35:24.042065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"23'23","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061922+0000","last_change":"2024-04-25T10:33:43.183648+0000","last_active":"2024-04-25T10:35:24.061922+0000","last_peered":"2024-04-25T10:35:24.061922+0000","last_clean":"2024-04-25T10:35:24.061922+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:35:24.061922+0000","last_undegraded":"2024-04-25T10:35:24.061922+0000","last_fullsized":"2024-04-25T10:35:24.061922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'16","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.066567+0000","last_change":"2024-04-25T10:33:43.175229+0000","last_active":"2024-04-25T10:35:24.066567+0000","last_peered":"2024-04-25T10:35:24.066567+0000","last_clean":"2024-04-25T10:35:24.066567+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:35:24.066567+0000","last_undegraded":"2024-04-25T10:35:24.066567+0000","last_fullsized":"2024-04-25T10:35:24.066567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.059707+0000","last_change":"2024-04-25T10:33:43.162579+0000","last_active":"2024-04-25T10:35:24.059707+0000","last_peered":"2024-04-25T10:35:24.059707+0000","last_clean":"2024-04-25T10:35:24.059707+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:35:24.059707+0000","last_undegraded":"2024-04-25T10:35:24.059707+0000","last_fullsized":"2024-04-25T10:35:24.059707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'14","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.066410+0000","last_change":"2024-04-25T10:33:43.168576+0000","last_active":"2024-04-25T10:35:24.066410+0000","last_peered":"2024-04-25T10:35:24.066410+0000","last_clean":"2024-04-25T10:35:24.066410+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:35:24.066410+0000","last_undegraded":"2024-04-25T10:35:24.066410+0000","last_fullsized":"2024-04-25T10:35:24.066410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'18","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065476+0000","last_change":"2024-04-25T10:33:43.182970+0000","last_active":"2024-04-25T10:35:24.065476+0000","last_peered":"2024-04-25T10:35:24.065476+0000","last_clean":"2024-04-25T10:35:24.065476+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:35:24.065476+0000","last_undegraded":"2024-04-25T10:35:24.065476+0000","last_fullsized":"2024-04-25T10:35:24.065476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'19","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.058488+0000","last_change":"2024-04-25T10:33:43.171456+0000","last_active":"2024-04-25T10:35:24.058488+0000","last_peered":"2024-04-25T10:35:24.058488+0000","last_clean":"2024-04-25T10:35:24.058488+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:35:24.058488+0000","last_undegraded":"2024-04-25T10:35:24.058488+0000","last_fullsized":"2024-04-25T10:35:24.058488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'18","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.068863+0000","last_change":"2024-04-25T10:33:43.183419+0000","last_active":"2024-04-25T10:35:24.068863+0000","last_peered":"2024-04-25T10:35:24.068863+0000","last_clean":"2024-04-25T10:35:24.068863+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:35:24.068863+0000","last_undegraded":"2024-04-25T10:35:24.068863+0000","last_fullsized":"2024-04-25T10:35:24.068863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:37.066156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'18","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065488+0000","last_change":"2024-04-25T10:33:43.170134+0000","last_active":"2024-04-25T10:35:24.065488+0000","last_peered":"2024-04-25T10:35:24.065488+0000","last_clean":"2024-04-25T10:35:24.065488+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:35:24.065488+0000","last_undegraded":"2024-04-25T10:35:24.065488+0000","last_fullsized":"2024-04-25T10:35:24.065488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:06.463548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599586+0000","last_change":"2024-04-25T10:33:42.162138+0000","last_active":"2024-04-25T10:35:19.599586+0000","last_peered":"2024-04-25T10:35:19.599586+0000","last_clean":"2024-04-25T10:35:19.599586+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:35:19.599586+0000","last_undegraded":"2024-04-25T10:35:19.599586+0000","last_fullsized":"2024-04-25T10:35:19.599586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'17","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.064738+0000","last_change":"2024-04-25T10:33:43.172141+0000","last_active":"2024-04-25T10:35:24.064738+0000","last_peered":"2024-04-25T10:35:24.064738+0000","last_clean":"2024-04-25T10:35:24.064738+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:35:24.064738+0000","last_undegraded":"2024-04-25T10:35:24.064738+0000","last_fullsized":"2024-04-25T10:35:24.064738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594071+0000","last_change":"2024-04-25T10:33:42.161614+0000","last_active":"2024-04-25T10:35:19.594071+0000","last_peered":"2024-04-25T10:35:19.594071+0000","last_clean":"2024-04-25T10:35:19.594071+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:35:19.594071+0000","last_undegraded":"2024-04-25T10:35:19.594071+0000","last_fullsized":"2024-04-25T10:35:19.594071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599385+0000","last_change":"2024-04-25T10:33:42.158934+0000","last_active":"2024-04-25T10:35:19.599385+0000","last_peered":"2024-04-25T10:35:19.599385+0000","last_clean":"2024-04-25T10:35:19.599385+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:35:19.599385+0000","last_undegraded":"2024-04-25T10:35:19.599385+0000","last_fullsized":"2024-04-25T10:35:19.599385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'17","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.066065+0000","last_change":"2024-04-25T10:33:43.170270+0000","last_active":"2024-04-25T10:35:24.066065+0000","last_peered":"2024-04-25T10:35:24.066065+0000","last_clean":"2024-04-25T10:35:24.066065+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:35:24.066065+0000","last_undegraded":"2024-04-25T10:35:24.066065+0000","last_fullsized":"2024-04-25T10:35:24.066065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591039+0000","last_change":"2024-04-25T10:33:42.162167+0000","last_active":"2024-04-25T10:35:19.591039+0000","last_peered":"2024-04-25T10:35:19.591039+0000","last_clean":"2024-04-25T10:35:19.591039+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:35:19.591039+0000","last_undegraded":"2024-04-25T10:35:19.591039+0000","last_fullsized":"2024-04-25T10:35:19.591039+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'18","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065980+0000","last_change":"2024-04-25T10:33:43.174366+0000","last_active":"2024-04-25T10:35:24.065980+0000","last_peered":"2024-04-25T10:35:24.065980+0000","last_clean":"2024-04-25T10:35:24.065980+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:35:24.065980+0000","last_undegraded":"2024-04-25T10:35:24.065980+0000","last_fullsized":"2024-04-25T10:35:24.065980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594335+0000","last_change":"2024-04-25T10:33:42.163161+0000","last_active":"2024-04-25T10:35:19.594335+0000","last_peered":"2024-04-25T10:35:19.594335+0000","last_clean":"2024-04-25T10:35:19.594335+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:35:19.594335+0000","last_undegraded":"2024-04-25T10:35:19.594335+0000","last_fullsized":"2024-04-25T10:35:19.594335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'17","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.062353+0000","last_change":"2024-04-25T10:33:43.179159+0000","last_active":"2024-04-25T10:35:24.062353+0000","last_peered":"2024-04-25T10:35:24.062353+0000","last_clean":"2024-04-25T10:35:24.062353+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:35:24.062353+0000","last_undegraded":"2024-04-25T10:35:24.062353+0000","last_fullsized":"2024-04-25T10:35:24.062353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591501+0000","last_change":"2024-04-25T10:33:42.168608+0000","last_active":"2024-04-25T10:35:19.591501+0000","last_peered":"2024-04-25T10:35:19.591501+0000","last_clean":"2024-04-25T10:35:19.591501+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:35:19.591501+0000","last_undegraded":"2024-04-25T10:35:19.591501+0000","last_fullsized":"2024-04-25T10:35:19.591501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'17","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061938+0000","last_change":"2024-04-25T10:33:43.172553+0000","last_active":"2024-04-25T10:35:24.061938+0000","last_peered":"2024-04-25T10:35:24.061938+0000","last_clean":"2024-04-25T10:35:24.061938+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:35:24.061938+0000","last_undegraded":"2024-04-25T10:35:24.061938+0000","last_fullsized":"2024-04-25T10:35:24.061938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'6","reported_seq":26,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590248+0000","last_change":"2024-04-25T10:33:42.160656+0000","last_active":"2024-04-25T10:35:19.590248+0000","last_peered":"2024-04-25T10:35:19.590248+0000","last_clean":"2024-04-25T10:35:19.590248+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:35:19.590248+0000","last_undegraded":"2024-04-25T10:35:19.590248+0000","last_fullsized":"2024-04-25T10:35:19.590248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:16.669213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'19","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061708+0000","last_change":"2024-04-25T10:33:43.178426+0000","last_active":"2024-04-25T10:35:24.061708+0000","last_peered":"2024-04-25T10:35:24.061708+0000","last_clean":"2024-04-25T10:35:24.061708+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:35:24.061708+0000","last_undegraded":"2024-04-25T10:35:24.061708+0000","last_fullsized":"2024-04-25T10:35:24.061708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:23.929310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'114","reported_seq":134,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.080999+0000","last_change":"2024-04-25T10:33:42.160251+0000","last_active":"2024-04-25T10:35:24.080999+0000","last_peered":"2024-04-25T10:35:24.080999+0000","last_clean":"2024-04-25T10:35:24.080999+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:35:24.080999+0000","last_undegraded":"2024-04-25T10:35:24.080999+0000","last_fullsized":"2024-04-25T10:35:24.080999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143369,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'14","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.073726+0000","last_change":"2024-04-25T10:33:43.180666+0000","last_active":"2024-04-25T10:35:24.073726+0000","last_peered":"2024-04-25T10:35:24.073726+0000","last_clean":"2024-04-25T10:35:24.073726+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:35:24.073726+0000","last_undegraded":"2024-04-25T10:35:24.073726+0000","last_fullsized":"2024-04-25T10:35:24.073726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619623+0000","last_change":"2024-04-25T10:33:42.164005+0000","last_active":"2024-04-25T10:35:19.619623+0000","last_peered":"2024-04-25T10:35:19.619623+0000","last_clean":"2024-04-25T10:35:19.619623+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:35:19.619623+0000","last_undegraded":"2024-04-25T10:35:19.619623+0000","last_fullsized":"2024-04-25T10:35:19.619623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:24:54.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'19","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065051+0000","last_change":"2024-04-25T10:33:43.181483+0000","last_active":"2024-04-25T10:35:24.065051+0000","last_peered":"2024-04-25T10:35:24.065051+0000","last_clean":"2024-04-25T10:35:24.065051+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:35:24.065051+0000","last_undegraded":"2024-04-25T10:35:24.065051+0000","last_fullsized":"2024-04-25T10:35:24.065051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:42.713890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591150+0000","last_change":"2024-04-25T10:33:42.163146+0000","last_active":"2024-04-25T10:35:19.591150+0000","last_peered":"2024-04-25T10:35:19.591150+0000","last_clean":"2024-04-25T10:35:19.591150+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:35:19.591150+0000","last_undegraded":"2024-04-25T10:35:19.591150+0000","last_fullsized":"2024-04-25T10:35:19.591150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'27","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061414+0000","last_change":"2024-04-25T10:33:43.183314+0000","last_active":"2024-04-25T10:35:24.061414+0000","last_peered":"2024-04-25T10:35:24.061414+0000","last_clean":"2024-04-25T10:35:24.061414+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:35:24.061414+0000","last_undegraded":"2024-04-25T10:35:24.061414+0000","last_fullsized":"2024-04-25T10:35:24.061414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:26:07.841471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.593969+0000","last_change":"2024-04-25T10:33:42.166542+0000","last_active":"2024-04-25T10:35:19.593969+0000","last_peered":"2024-04-25T10:35:19.593969+0000","last_clean":"2024-04-25T10:35:19.593969+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:35:19.593969+0000","last_undegraded":"2024-04-25T10:35:19.593969+0000","last_fullsized":"2024-04-25T10:35:19.593969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'15","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.068722+0000","last_change":"2024-04-25T10:33:43.176217+0000","last_active":"2024-04-25T10:35:24.068722+0000","last_peered":"2024-04-25T10:35:24.068722+0000","last_clean":"2024-04-25T10:35:24.068722+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:35:24.068722+0000","last_undegraded":"2024-04-25T10:35:24.068722+0000","last_fullsized":"2024-04-25T10:35:24.068722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620234+0000","last_change":"2024-04-25T10:33:42.156163+0000","last_active":"2024-04-25T10:35:19.620234+0000","last_peered":"2024-04-25T10:35:19.620234+0000","last_clean":"2024-04-25T10:35:19.620234+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:35:19.620234+0000","last_undegraded":"2024-04-25T10:35:19.620234+0000","last_fullsized":"2024-04-25T10:35:19.620234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'14","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061116+0000","last_change":"2024-04-25T10:33:43.183091+0000","last_active":"2024-04-25T10:35:24.061116+0000","last_peered":"2024-04-25T10:35:24.061116+0000","last_clean":"2024-04-25T10:35:24.061116+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:35:24.061116+0000","last_undegraded":"2024-04-25T10:35:24.061116+0000","last_fullsized":"2024-04-25T10:35:24.061116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.592323+0000","last_change":"2024-04-25T10:33:42.162393+0000","last_active":"2024-04-25T10:35:19.592323+0000","last_peered":"2024-04-25T10:35:19.592323+0000","last_clean":"2024-04-25T10:35:19.592323+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:35:19.592323+0000","last_undegraded":"2024-04-25T10:35:19.592323+0000","last_fullsized":"2024-04-25T10:35:19.592323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:57.969551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'12","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.044117+0000","last_change":"2024-04-25T10:34:24.298321+0000","last_active":"2024-04-25T10:35:24.044117+0000","last_peered":"2024-04-25T10:35:24.044117+0000","last_clean":"2024-04-25T10:35:24.044117+0000","last_became_active":"2024-04-25T10:34:24.298059+0000","last_became_peered":"2024-04-25T10:34:24.298059+0000","last_unstale":"2024-04-25T10:35:24.044117+0000","last_undegraded":"2024-04-25T10:35:24.044117+0000","last_fullsized":"2024-04-25T10:35:24.044117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:15.287781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620569+0000","last_change":"2024-04-25T10:33:42.159468+0000","last_active":"2024-04-25T10:35:19.620569+0000","last_peered":"2024-04-25T10:35:19.620569+0000","last_clean":"2024-04-25T10:35:19.620569+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:35:19.620569+0000","last_undegraded":"2024-04-25T10:35:19.620569+0000","last_fullsized":"2024-04-25T10:35:19.620569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'17","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061775+0000","last_change":"2024-04-25T10:33:43.181841+0000","last_active":"2024-04-25T10:35:24.061775+0000","last_peered":"2024-04-25T10:35:24.061775+0000","last_clean":"2024-04-25T10:35:24.061775+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:35:24.061775+0000","last_undegraded":"2024-04-25T10:35:24.061775+0000","last_fullsized":"2024-04-25T10:35:24.061775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:37.937673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590270+0000","last_change":"2024-04-25T10:33:42.152094+0000","last_active":"2024-04-25T10:35:19.590270+0000","last_peered":"2024-04-25T10:35:19.590270+0000","last_clean":"2024-04-25T10:35:19.590270+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:35:19.590270+0000","last_undegraded":"2024-04-25T10:35:19.590270+0000","last_fullsized":"2024-04-25T10:35:19.590270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:22.924435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'18","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.049419+0000","last_change":"2024-04-25T10:34:24.299747+0000","last_active":"2024-04-25T10:35:24.049419+0000","last_peered":"2024-04-25T10:35:24.049419+0000","last_clean":"2024-04-25T10:35:24.049419+0000","last_became_active":"2024-04-25T10:34:24.299411+0000","last_became_peered":"2024-04-25T10:34:24.299411+0000","last_unstale":"2024-04-25T10:35:24.049419+0000","last_undegraded":"2024-04-25T10:35:24.049419+0000","last_fullsized":"2024-04-25T10:35:24.049419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:24.720369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620411+0000","last_change":"2024-04-25T10:33:42.167140+0000","last_active":"2024-04-25T10:35:19.620411+0000","last_peered":"2024-04-25T10:35:19.620411+0000","last_clean":"2024-04-25T10:35:19.620411+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:35:19.620411+0000","last_undegraded":"2024-04-25T10:35:19.620411+0000","last_fullsized":"2024-04-25T10:35:19.620411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'15","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.064533+0000","last_change":"2024-04-25T10:33:43.184750+0000","last_active":"2024-04-25T10:35:24.064533+0000","last_peered":"2024-04-25T10:35:24.064533+0000","last_clean":"2024-04-25T10:35:24.064533+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:35:24.064533+0000","last_undegraded":"2024-04-25T10:35:24.064533+0000","last_fullsized":"2024-04-25T10:35:24.064533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:38.786898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":116,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620399+0000","last_change":"2024-04-25T10:33:31.708843+0000","last_active":"2024-04-25T10:35:19.620399+0000","last_peered":"2024-04-25T10:35:19.620399+0000","last_clean":"2024-04-25T10:35:19.620399+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:35:19.620399+0000","last_undegraded":"2024-04-25T10:35:19.620399+0000","last_fullsized":"2024-04-25T10:35:19.620399+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:30.626866+0000","last_clean_scrub_stamp":"2024-04-25T10:33:30.626866+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:10.475782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591077+0000","last_change":"2024-04-25T10:33:42.164505+0000","last_active":"2024-04-25T10:35:19.591077+0000","last_peered":"2024-04-25T10:35:19.591077+0000","last_clean":"2024-04-25T10:35:19.591077+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:35:19.591077+0000","last_undegraded":"2024-04-25T10:35:19.591077+0000","last_fullsized":"2024-04-25T10:35:19.591077+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.063616+0000","last_change":"2024-04-25T10:33:43.169958+0000","last_active":"2024-04-25T10:35:24.063616+0000","last_peered":"2024-04-25T10:35:24.063616+0000","last_clean":"2024-04-25T10:35:24.063616+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:35:24.063616+0000","last_undegraded":"2024-04-25T10:35:24.063616+0000","last_fullsized":"2024-04-25T10:35:24.063616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620280+0000","last_change":"2024-04-25T10:33:42.163852+0000","last_active":"2024-04-25T10:35:19.620280+0000","last_peered":"2024-04-25T10:35:19.620280+0000","last_clean":"2024-04-25T10:35:19.620280+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:35:19.620280+0000","last_undegraded":"2024-04-25T10:35:19.620280+0000","last_fullsized":"2024-04-25T10:35:19.620280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:28.602376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'10","reported_seq":28,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.056324+0000","last_change":"2024-04-25T10:33:43.165039+0000","last_active":"2024-04-25T10:35:24.056324+0000","last_peered":"2024-04-25T10:35:24.056324+0000","last_clean":"2024-04-25T10:35:24.056324+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:35:24.056324+0000","last_undegraded":"2024-04-25T10:35:24.056324+0000","last_fullsized":"2024-04-25T10:35:24.056324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:30.822807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'4","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.219584+0000","last_change":"2024-04-25T10:33:42.160012+0000","last_active":"2024-04-25T10:35:24.219584+0000","last_peered":"2024-04-25T10:35:24.219584+0000","last_clean":"2024-04-25T10:35:24.219584+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:35:24.219584+0000","last_undegraded":"2024-04-25T10:35:24.219584+0000","last_fullsized":"2024-04-25T10:35:24.219584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.093269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1111,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'21","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.054336+0000","last_change":"2024-04-25T10:33:43.170473+0000","last_active":"2024-04-25T10:35:24.054336+0000","last_peered":"2024-04-25T10:35:24.054336+0000","last_clean":"2024-04-25T10:35:24.054336+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:35:24.054336+0000","last_undegraded":"2024-04-25T10:35:24.054336+0000","last_fullsized":"2024-04-25T10:35:24.054336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:52.964241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.591303+0000","last_change":"2024-04-25T10:33:42.161197+0000","last_active":"2024-04-25T10:35:19.591303+0000","last_peered":"2024-04-25T10:35:19.591303+0000","last_clean":"2024-04-25T10:35:19.591303+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:35:19.591303+0000","last_undegraded":"2024-04-25T10:35:19.591303+0000","last_fullsized":"2024-04-25T10:35:19.591303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'11","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.062990+0000","last_change":"2024-04-25T10:33:43.172447+0000","last_active":"2024-04-25T10:35:24.062990+0000","last_peered":"2024-04-25T10:35:24.062990+0000","last_clean":"2024-04-25T10:35:24.062990+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:35:24.062990+0000","last_undegraded":"2024-04-25T10:35:24.062990+0000","last_fullsized":"2024-04-25T10:35:24.062990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:19.195134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590171+0000","last_change":"2024-04-25T10:33:42.161100+0000","last_active":"2024-04-25T10:35:19.590171+0000","last_peered":"2024-04-25T10:35:19.590171+0000","last_clean":"2024-04-25T10:35:19.590171+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:35:19.590171+0000","last_undegraded":"2024-04-25T10:35:19.590171+0000","last_fullsized":"2024-04-25T10:35:19.590171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:05.458673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'13","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065554+0000","last_change":"2024-04-25T10:33:43.175361+0000","last_active":"2024-04-25T10:35:24.065554+0000","last_peered":"2024-04-25T10:35:24.065554+0000","last_clean":"2024-04-25T10:35:24.065554+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:35:24.065554+0000","last_undegraded":"2024-04-25T10:35:24.065554+0000","last_fullsized":"2024-04-25T10:35:24.065554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:27.598646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620761+0000","last_change":"2024-04-25T10:33:42.170292+0000","last_active":"2024-04-25T10:35:19.620761+0000","last_peered":"2024-04-25T10:35:19.620761+0000","last_clean":"2024-04-25T10:35:19.620761+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:35:19.620761+0000","last_undegraded":"2024-04-25T10:35:19.620761+0000","last_fullsized":"2024-04-25T10:35:19.620761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:47.392698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'16","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.052403+0000","last_change":"2024-04-25T10:33:43.170285+0000","last_active":"2024-04-25T10:35:24.052403+0000","last_peered":"2024-04-25T10:35:24.052403+0000","last_clean":"2024-04-25T10:35:24.052403+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:35:24.052403+0000","last_undegraded":"2024-04-25T10:35:24.052403+0000","last_fullsized":"2024-04-25T10:35:24.052403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'5","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:20.181100+0000","last_change":"2024-04-25T10:33:42.160069+0000","last_active":"2024-04-25T10:35:20.181100+0000","last_peered":"2024-04-25T10:35:20.181100+0000","last_clean":"2024-04-25T10:35:20.181100+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:35:20.181100+0000","last_undegraded":"2024-04-25T10:35:20.181100+0000","last_fullsized":"2024-04-25T10:35:20.181100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:28:18.190259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'15","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.062702+0000","last_change":"2024-04-25T10:33:43.181641+0000","last_active":"2024-04-25T10:35:24.062702+0000","last_peered":"2024-04-25T10:35:24.062702+0000","last_clean":"2024-04-25T10:35:24.062702+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:35:24.062702+0000","last_undegraded":"2024-04-25T10:35:24.062702+0000","last_fullsized":"2024-04-25T10:35:24.062702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:44.278064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.594344+0000","last_change":"2024-04-25T10:33:42.165706+0000","last_active":"2024-04-25T10:35:19.594344+0000","last_peered":"2024-04-25T10:35:19.594344+0000","last_clean":"2024-04-25T10:35:19.594344+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:35:19.594344+0000","last_undegraded":"2024-04-25T10:35:19.594344+0000","last_fullsized":"2024-04-25T10:35:19.594344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'19","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065559+0000","last_change":"2024-04-25T10:33:43.173260+0000","last_active":"2024-04-25T10:35:24.065559+0000","last_peered":"2024-04-25T10:35:24.065559+0000","last_clean":"2024-04-25T10:35:24.065559+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:35:24.065559+0000","last_undegraded":"2024-04-25T10:35:24.065559+0000","last_fullsized":"2024-04-25T10:35:24.065559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620263+0000","last_change":"2024-04-25T10:33:42.166946+0000","last_active":"2024-04-25T10:35:19.620263+0000","last_peered":"2024-04-25T10:35:19.620263+0000","last_clean":"2024-04-25T10:35:19.620263+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:35:19.620263+0000","last_undegraded":"2024-04-25T10:35:19.620263+0000","last_fullsized":"2024-04-25T10:35:19.620263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:29.817932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'7","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.055152+0000","last_change":"2024-04-25T10:33:43.170510+0000","last_active":"2024-04-25T10:35:24.055152+0000","last_peered":"2024-04-25T10:35:24.055152+0000","last_clean":"2024-04-25T10:35:24.055152+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:35:24.055152+0000","last_undegraded":"2024-04-25T10:35:24.055152+0000","last_fullsized":"2024-04-25T10:35:24.055152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:17.674088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590156+0000","last_change":"2024-04-25T10:33:42.165204+0000","last_active":"2024-04-25T10:35:19.590156+0000","last_peered":"2024-04-25T10:35:19.590156+0000","last_clean":"2024-04-25T10:35:19.590156+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:35:19.590156+0000","last_undegraded":"2024-04-25T10:35:19.590156+0000","last_fullsized":"2024-04-25T10:35:19.590156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:00.243087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'16","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.062729+0000","last_change":"2024-04-25T10:33:43.168088+0000","last_active":"2024-04-25T10:35:24.062729+0000","last_peered":"2024-04-25T10:35:24.062729+0000","last_clean":"2024-04-25T10:35:24.062729+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:35:24.062729+0000","last_undegraded":"2024-04-25T10:35:24.062729+0000","last_fullsized":"2024-04-25T10:35:24.062729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:40.276276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.590347+0000","last_change":"2024-04-25T10:33:42.156381+0000","last_active":"2024-04-25T10:35:19.590347+0000","last_peered":"2024-04-25T10:35:19.590347+0000","last_clean":"2024-04-25T10:35:19.590347+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:35:19.590347+0000","last_undegraded":"2024-04-25T10:35:19.590347+0000","last_fullsized":"2024-04-25T10:35:19.590347+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:53.209070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'18","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.067055+0000","last_change":"2024-04-25T10:33:43.167502+0000","last_active":"2024-04-25T10:35:24.067055+0000","last_peered":"2024-04-25T10:35:24.067055+0000","last_clean":"2024-04-25T10:35:24.067055+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:35:24.067055+0000","last_undegraded":"2024-04-25T10:35:24.067055+0000","last_fullsized":"2024-04-25T10:35:24.067055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:05.790918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620596+0000","last_change":"2024-04-25T10:33:42.168840+0000","last_active":"2024-04-25T10:35:19.620596+0000","last_peered":"2024-04-25T10:35:19.620596+0000","last_clean":"2024-04-25T10:35:19.620596+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:35:19.620596+0000","last_undegraded":"2024-04-25T10:35:19.620596+0000","last_fullsized":"2024-04-25T10:35:19.620596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:51.048447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'14","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.051006+0000","last_change":"2024-04-25T10:33:43.174672+0000","last_active":"2024-04-25T10:35:24.051006+0000","last_peered":"2024-04-25T10:35:24.051006+0000","last_clean":"2024-04-25T10:35:24.051006+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:35:24.051006+0000","last_undegraded":"2024-04-25T10:35:24.051006+0000","last_fullsized":"2024-04-25T10:35:24.051006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:56.277185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'23","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.064019+0000","last_change":"2024-04-25T10:33:43.179274+0000","last_active":"2024-04-25T10:35:24.064019+0000","last_peered":"2024-04-25T10:35:24.064019+0000","last_clean":"2024-04-25T10:35:24.064019+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:35:24.064019+0000","last_undegraded":"2024-04-25T10:35:24.064019+0000","last_fullsized":"2024-04-25T10:35:24.064019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:24.341521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620487+0000","last_change":"2024-04-25T10:33:42.168654+0000","last_active":"2024-04-25T10:35:19.620487+0000","last_peered":"2024-04-25T10:35:19.620487+0000","last_clean":"2024-04-25T10:35:19.620487+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:35:19.620487+0000","last_undegraded":"2024-04-25T10:35:19.620487+0000","last_fullsized":"2024-04-25T10:35:19.620487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:15.158541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'13","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.057292+0000","last_change":"2024-04-25T10:33:43.170923+0000","last_active":"2024-04-25T10:35:24.057292+0000","last_peered":"2024-04-25T10:35:24.057292+0000","last_clean":"2024-04-25T10:35:24.057292+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:35:24.057292+0000","last_undegraded":"2024-04-25T10:35:24.057292+0000","last_fullsized":"2024-04-25T10:35:24.057292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:21.690972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'3","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.620653+0000","last_change":"2024-04-25T10:33:42.171374+0000","last_active":"2024-04-25T10:35:19.620653+0000","last_peered":"2024-04-25T10:35:19.620653+0000","last_clean":"2024-04-25T10:35:19.620653+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:35:19.620653+0000","last_undegraded":"2024-04-25T10:35:19.620653+0000","last_fullsized":"2024-04-25T10:35:19.620653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:41.709015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'16","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.064645+0000","last_change":"2024-04-25T10:33:43.172788+0000","last_active":"2024-04-25T10:35:24.064645+0000","last_peered":"2024-04-25T10:35:24.064645+0000","last_clean":"2024-04-25T10:35:24.064645+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:35:24.064645+0000","last_undegraded":"2024-04-25T10:35:24.064645+0000","last_fullsized":"2024-04-25T10:35:24.064645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.599727+0000","last_change":"2024-04-25T10:33:42.161364+0000","last_active":"2024-04-25T10:35:19.599727+0000","last_peered":"2024-04-25T10:35:19.599727+0000","last_clean":"2024-04-25T10:35:19.599727+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:35:19.599727+0000","last_undegraded":"2024-04-25T10:35:19.599727+0000","last_fullsized":"2024-04-25T10:35:19.599727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:44.893574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'11","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.047413+0000","last_change":"2024-04-25T10:33:43.177654+0000","last_active":"2024-04-25T10:35:24.047413+0000","last_peered":"2024-04-25T10:35:24.047413+0000","last_clean":"2024-04-25T10:35:24.047413+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:35:24.047413+0000","last_undegraded":"2024-04-25T10:35:24.047413+0000","last_fullsized":"2024-04-25T10:35:24.047413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:46.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:19.619679+0000","last_change":"2024-04-25T10:33:42.167156+0000","last_active":"2024-04-25T10:35:19.619679+0000","last_peered":"2024-04-25T10:35:19.619679+0000","last_clean":"2024-04-25T10:35:19.619679+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:35:19.619679+0000","last_undegraded":"2024-04-25T10:35:19.619679+0000","last_fullsized":"2024-04-25T10:35:19.619679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:41.136244+0000","last_clean_scrub_stamp":"2024-04-25T10:33:41.136244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:13:20.295623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":42,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":145278,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":163,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":290556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":851968,"data_stored":680186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":232596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":89320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":89356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":233716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":90344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,3,17,26],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":89393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":680239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":144480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":143369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:35:31.164 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.164 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.164 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.164 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.164 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.164 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.164 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.165 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.166 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.167 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.168 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.169 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.170 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T10:33:30.626866+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=30, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.171 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.172 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.173 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.174 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.174 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.174 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.174 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.174 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.174 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.174 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T10:33:41.136244+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=41, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:31.174 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T10:35:43.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:35:43.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:35:51.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:35:51.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.292+0000 7f49d06ee640 1 Processor -- start 2024-04-25T10:35:51.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.292+0000 7f49d06ee640 1 -- start start 2024-04-25T10:35:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.293+0000 7f49d06ee640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49c80720e0 0x7f49c80b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.293+0000 7f49d06ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f49c80b84e0 0x7f49c80b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.293+0000 7f49d06ee640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c80b27c0 con 0x7f49c80b23b0 2024-04-25T10:35:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.293+0000 7f49d06ee640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f49c8071970 con 0x7f49c80720e0 2024-04-25T10:35:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.293+0000 7f49d06ee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f49c80b2a80 con 0x7f49c80b84e0 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.293+0000 7f49ce48a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f49c80720e0 0x7f49c80b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.293+0000 7f49cdc89640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f49c80b23b0 0x7f49c81472a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:48884/0 (socket says 172.21.15.103:48884) 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.293+0000 7f49cdc89640 1 -- 172.21.15.103:0/3644374249 learned_addr learned my addr 172.21.15.103:0/3644374249 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.294+0000 7f49cec8b640 1 --2- 172.21.15.103:0/3644374249 >> v2:172.21.15.132:3300/0 conn(0x7f49c80b84e0 0x7f49c80b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.294+0000 7f49ce48a640 1 -- 172.21.15.103:0/3644374249 >> v2:172.21.15.132:3300/0 conn(0x7f49c80b84e0 msgr2=0x7f49c80b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.294+0000 7f49ce48a640 1 --2- 172.21.15.103:0/3644374249 >> v2:172.21.15.132:3300/0 conn(0x7f49c80b84e0 0x7f49c80b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.294+0000 7f49ce48a640 1 -- 172.21.15.103:0/3644374249 >> v1:172.21.15.103:6789/0 conn(0x7f49c80b23b0 legacy=0x7f49c81472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.294+0000 7f49cd488640 1 -- 172.21.15.103:0/3644374249 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886704354 0 0) 0x7f49c80b27c0 con 0x7f49c80b23b0 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.294+0000 7f49ce48a640 1 -- 172.21.15.103:0/3644374249 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c8071bc0 con 0x7f49c80720e0 2024-04-25T10:35:51.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.294+0000 7f49cec8b640 1 --2- 172.21.15.103:0/3644374249 >> v2:172.21.15.132:3300/0 conn(0x7f49c80b84e0 0x7f49c80b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:35:51.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.294+0000 7f49ce48a640 1 --2- 172.21.15.103:0/3644374249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80720e0 0x7f49c80b1df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f49c8073320 tx=0x7f49c402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618b701a8cada376 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49cd488640 1 -- 172.21.15.103:0/3644374249 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4007740 con 0x7f49c80720e0 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49cd488640 1 -- 172.21.15.103:0/3644374249 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c40078e0 con 0x7f49c80720e0 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49cd488640 1 -- 172.21.15.103:0/3644374249 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4007cb0 con 0x7f49c80720e0 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49d06ee640 1 -- 172.21.15.103:0/3644374249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80720e0 msgr2=0x7f49c80b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49d06ee640 1 --2- 172.21.15.103:0/3644374249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80720e0 0x7f49c80b1df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f49c8073320 tx=0x7f49c402a5f0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49d06ee640 1 -- 172.21.15.103:0/3644374249 shutdown_connections 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49d06ee640 1 --2- 172.21.15.103:0/3644374249 >> v2:172.21.15.132:3300/0 conn(0x7f49c80b84e0 0x7f49c80b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49d06ee640 1 --2- 172.21.15.103:0/3644374249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80720e0 0x7f49c80b1df0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49d06ee640 1 -- 172.21.15.103:0/3644374249 >> 172.21.15.103:0/3644374249 conn(0x7f49c80b93f0 msgr2=0x7f49c80b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49d06ee640 1 -- 172.21.15.103:0/3644374249 shutdown_connections 2024-04-25T10:35:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.295+0000 7f49d06ee640 1 -- 172.21.15.103:0/3644374249 wait complete. 2024-04-25T10:35:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.297+0000 7f49d06ee640 1 Processor -- start 2024-04-25T10:35:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.297+0000 7f49d06ee640 1 -- start start 2024-04-25T10:35:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49d06ee640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49c80720e0 0x7f49c806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49d06ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80b23b0 0x7f49c8143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49d06ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49c80b84e0 0x7f49c813dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49d06ee640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f49c80b6660 con 0x7f49c80b23b0 2024-04-25T10:35:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49d06ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f49c80b64e0 con 0x7f49c80b84e0 2024-04-25T10:35:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49d06ee640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f49c8151bc0 con 0x7f49c80720e0 2024-04-25T10:35:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80b23b0 0x7f49c8143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80b23b0 0x7f49c8143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48252/0 (socket says 172.21.15.103:48252) 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 -- 172.21.15.103:0/603115243 learned_addr learned my addr 172.21.15.103:0/603115243 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49ce48a640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49c80720e0 0x7f49c806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cec8b640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49c80b84e0 0x7f49c813dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 -- 172.21.15.103:0/603115243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49c80720e0 msgr2=0x7f49c806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49c80720e0 0x7f49c806eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 -- 172.21.15.103:0/603115243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49c80b84e0 msgr2=0x7f49c813dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49c80b84e0 0x7f49c813dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 -- 172.21.15.103:0/603115243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c80a2950 con 0x7f49c80b23b0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.298+0000 7f49cdc89640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80b23b0 0x7f49c8143630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c430 tx=0x7f49b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.299+0000 7f49beffd640 1 -- 172.21.15.103:0/603115243 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80074e0 con 0x7f49c80b23b0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.299+0000 7f49beffd640 1 -- 172.21.15.103:0/603115243 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b80047e0 con 0x7f49c80b23b0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.299+0000 7f49beffd640 1 -- 172.21.15.103:0/603115243 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8004bd0 con 0x7f49c80b23b0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.299+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c8142e10 con 0x7f49c80b23b0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.299+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c81df2b0 con 0x7f49c80b23b0 2024-04-25T10:35:51.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.300+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c806a130 con 0x7f49c80b23b0 2024-04-25T10:35:51.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.300+0000 7f49beffd640 1 -- 172.21.15.103:0/603115243 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f49b8011070 con 0x7f49c80b23b0 2024-04-25T10:35:51.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.301+0000 7f49beffd640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f49ac0744e0 0x7f49ac0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:35:51.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.301+0000 7f49beffd640 1 -- 172.21.15.103:0/603115243 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f49b8094c30 con 0x7f49c80b23b0 2024-04-25T10:35:51.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.301+0000 7f49ce48a640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f49ac0744e0 0x7f49ac0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:35:51.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.301+0000 7f49ce48a640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f49ac0744e0 0x7f49ac0769f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f49c4034000 tx=0x7f49c402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:35:51.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.306+0000 7f49beffd640 1 -- 172.21.15.103:0/603115243 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f49b805edf0 con 0x7f49c80b23b0 2024-04-25T10:35:51.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.478+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49c80b3440 con 0x7f49ac0744e0 2024-04-25T10:35:51.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.484+0000 7f49beffd640 1 -- 172.21.15.103:0/603115243 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252347 (secure 0 0 0) 0x7f49c80b3440 con 0x7f49ac0744e0 2024-04-25T10:35:51.489 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:35:51.490 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:35:51.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.486+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f49ac0744e0 msgr2=0x7f49ac0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.486+0000 7f49d06ee640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f49ac0744e0 0x7f49ac0769f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f49c4034000 tx=0x7f49c402f000 comp rx=0 tx=0).stop 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.486+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80b23b0 msgr2=0x7f49c8143630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.486+0000 7f49d06ee640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80b23b0 0x7f49c8143630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c430 tx=0x7f49b800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.486+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 shutdown_connections 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.486+0000 7f49d06ee640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f49ac0744e0 0x7f49ac0769f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.486+0000 7f49d06ee640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49c80b84e0 0x7f49c813dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.487+0000 7f49d06ee640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49c80b23b0 0x7f49c8143630 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.487+0000 7f49d06ee640 1 --2- 172.21.15.103:0/603115243 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f49c80720e0 0x7f49c806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.487+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 >> 172.21.15.103:0/603115243 conn(0x7f49c80b93f0 msgr2=0x7f49c8151300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.487+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 shutdown_connections 2024-04-25T10:35:51.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:35:51.487+0000 7f49d06ee640 1 -- 172.21.15.103:0/603115243 wait complete. 2024-04-25T10:35:51.500 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-04-25T10:35:50.522694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":742067,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":285,"num_write_kb":1868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1286,"ondisk_log_size":1286,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3547136,"data_stored":2197950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003310"},"pg_stats":[{"pgid":"3.3f","version":"23'15","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.732281+0000","last_change":"2024-04-25T10:35:31.732313+0000","last_active":"2024-04-25T10:35:31.732281+0000","last_peered":"2024-04-25T10:35:31.732281+0000","last_clean":"2024-04-25T10:35:31.732281+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:35:31.732281+0000","last_undegraded":"2024-04-25T10:35:31.732281+0000","last_fullsized":"2024-04-25T10:35:31.732281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:31.732176+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:31.732176+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.732176+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:30.190413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.403438+0000","last_change":"2024-04-25T10:35:35.403499+0000","last_active":"2024-04-25T10:35:35.403438+0000","last_peered":"2024-04-25T10:35:35.403438+0000","last_clean":"2024-04-25T10:35:35.403438+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:35:35.403438+0000","last_undegraded":"2024-04-25T10:35:35.403438+0000","last_fullsized":"2024-04-25T10:35:35.403438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:35.403294+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:35.403294+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.403294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:58.122725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'15","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.505623+0000","last_change":"2024-04-25T10:35:37.505663+0000","last_active":"2024-04-25T10:35:37.505623+0000","last_peered":"2024-04-25T10:35:37.505623+0000","last_clean":"2024-04-25T10:35:37.505623+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:35:37.505623+0000","last_undegraded":"2024-04-25T10:35:37.505623+0000","last_fullsized":"2024-04-25T10:35:37.505623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:37.505514+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:37.505514+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.505514+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:35.963752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'12","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.383347+0000","last_change":"2024-04-25T10:35:39.383347+0000","last_active":"2024-04-25T10:35:39.383347+0000","last_peered":"2024-04-25T10:35:39.383347+0000","last_clean":"2024-04-25T10:35:39.383347+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:35:39.383347+0000","last_undegraded":"2024-04-25T10:35:39.383347+0000","last_fullsized":"2024-04-25T10:35:39.383347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-04-25T10:35:39.383138+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-04-25T10:35:39.383138+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.383138+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:47.925469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'15","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:40.835850+0000","last_change":"2024-04-25T10:35:40.835882+0000","last_active":"2024-04-25T10:35:40.835850+0000","last_peered":"2024-04-25T10:35:40.835850+0000","last_clean":"2024-04-25T10:35:40.835850+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:35:40.835850+0000","last_undegraded":"2024-04-25T10:35:40.835850+0000","last_fullsized":"2024-04-25T10:35:40.835850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:40.835730+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:40.835730+0000","last_clean_scrub_stamp":"2024-04-25T10:35:40.835730+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:05.164260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.397934+0000","last_change":"2024-04-25T10:35:38.397964+0000","last_active":"2024-04-25T10:35:38.397934+0000","last_peered":"2024-04-25T10:35:38.397934+0000","last_clean":"2024-04-25T10:35:38.397934+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:35:38.397934+0000","last_undegraded":"2024-04-25T10:35:38.397934+0000","last_fullsized":"2024-04-25T10:35:38.397934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:38.397823+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:38.397823+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.397823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:44.817456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'11","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.065649+0000","last_change":"2024-04-25T10:33:43.186303+0000","last_active":"2024-04-25T10:35:24.065649+0000","last_peered":"2024-04-25T10:35:24.065649+0000","last_clean":"2024-04-25T10:35:24.065649+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:35:24.065649+0000","last_undegraded":"2024-04-25T10:35:24.065649+0000","last_fullsized":"2024-04-25T10:35:24.065649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.828815+0000","last_change":"2024-04-25T10:35:38.828871+0000","last_active":"2024-04-25T10:35:38.828815+0000","last_peered":"2024-04-25T10:35:38.828815+0000","last_clean":"2024-04-25T10:35:38.828815+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:35:38.828815+0000","last_undegraded":"2024-04-25T10:35:38.828815+0000","last_fullsized":"2024-04-25T10:35:38.828815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:38.828668+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:38.828668+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.828668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:01.130100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'18","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.064534+0000","last_change":"2024-04-25T10:34:24.321277+0000","last_active":"2024-04-25T10:35:24.064534+0000","last_peered":"2024-04-25T10:35:24.064534+0000","last_clean":"2024-04-25T10:35:24.064534+0000","last_became_active":"2024-04-25T10:34:24.320939+0000","last_became_peered":"2024-04-25T10:34:24.320939+0000","last_unstale":"2024-04-25T10:35:24.064534+0000","last_undegraded":"2024-04-25T10:35:24.064534+0000","last_fullsized":"2024-04-25T10:35:24.064534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'26","reported_seq":53,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.453251+0000","last_change":"2024-04-25T10:35:38.453281+0000","last_active":"2024-04-25T10:35:38.453251+0000","last_peered":"2024-04-25T10:35:38.453251+0000","last_clean":"2024-04-25T10:35:38.453251+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:35:38.453251+0000","last_undegraded":"2024-04-25T10:35:38.453251+0000","last_fullsized":"2024-04-25T10:35:38.453251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'26","last_scrub_stamp":"2024-04-25T10:35:38.453152+0000","last_deep_scrub":"23'26","last_deep_scrub_stamp":"2024-04-25T10:35:38.453152+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.453152+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:18.939304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.517865+0000","last_change":"2024-04-25T10:35:36.517896+0000","last_active":"2024-04-25T10:35:36.517865+0000","last_peered":"2024-04-25T10:35:36.517865+0000","last_clean":"2024-04-25T10:35:36.517865+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:35:36.517865+0000","last_undegraded":"2024-04-25T10:35:36.517865+0000","last_fullsized":"2024-04-25T10:35:36.517865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:36.517749+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:36.517749+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.517749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:00.695182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.654449+0000","last_change":"2024-04-25T10:35:33.654486+0000","last_active":"2024-04-25T10:35:33.654449+0000","last_peered":"2024-04-25T10:35:33.654449+0000","last_clean":"2024-04-25T10:35:33.654449+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:35:33.654449+0000","last_undegraded":"2024-04-25T10:35:33.654449+0000","last_fullsized":"2024-04-25T10:35:33.654449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-04-25T10:35:33.654306+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-04-25T10:35:33.654306+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.654306+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:13.407045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:40.844782+0000","last_change":"2024-04-25T10:35:40.844840+0000","last_active":"2024-04-25T10:35:40.844782+0000","last_peered":"2024-04-25T10:35:40.844782+0000","last_clean":"2024-04-25T10:35:40.844782+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:35:40.844782+0000","last_undegraded":"2024-04-25T10:35:40.844782+0000","last_fullsized":"2024-04-25T10:35:40.844782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:40.844663+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:40.844663+0000","last_clean_scrub_stamp":"2024-04-25T10:35:40.844663+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:18.180028+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'20","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.520880+0000","last_change":"2024-04-25T10:35:36.520908+0000","last_active":"2024-04-25T10:35:36.520880+0000","last_peered":"2024-04-25T10:35:36.520880+0000","last_clean":"2024-04-25T10:35:36.520880+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:35:36.520880+0000","last_undegraded":"2024-04-25T10:35:36.520880+0000","last_fullsized":"2024-04-25T10:35:36.520880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'20","last_scrub_stamp":"2024-04-25T10:35:36.520776+0000","last_deep_scrub":"23'20","last_deep_scrub_stamp":"2024-04-25T10:35:36.520776+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.520776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:00.698209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.456201+0000","last_change":"2024-04-25T10:35:37.456230+0000","last_active":"2024-04-25T10:35:37.456201+0000","last_peered":"2024-04-25T10:35:37.456201+0000","last_clean":"2024-04-25T10:35:37.456201+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:35:37.456201+0000","last_undegraded":"2024-04-25T10:35:37.456201+0000","last_fullsized":"2024-04-25T10:35:37.456201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:37.456096+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:37.456096+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.456096+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:35.914333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'21","reported_seq":48,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.309832+0000","last_change":"2024-04-25T10:35:36.309884+0000","last_active":"2024-04-25T10:35:36.309832+0000","last_peered":"2024-04-25T10:35:36.309832+0000","last_clean":"2024-04-25T10:35:36.309832+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:35:36.309832+0000","last_undegraded":"2024-04-25T10:35:36.309832+0000","last_fullsized":"2024-04-25T10:35:36.309832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'21","last_scrub_stamp":"2024-04-25T10:35:36.309690+0000","last_deep_scrub":"23'21","last_deep_scrub_stamp":"2024-04-25T10:35:36.309690+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.309690+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:58.611122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'16","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:44.461424+0000","last_change":"2024-04-25T10:35:44.461458+0000","last_active":"2024-04-25T10:35:44.461424+0000","last_peered":"2024-04-25T10:35:44.461424+0000","last_clean":"2024-04-25T10:35:44.461424+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:35:44.461424+0000","last_undegraded":"2024-04-25T10:35:44.461424+0000","last_fullsized":"2024-04-25T10:35:44.461424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:44.461294+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:44.461294+0000","last_clean_scrub_stamp":"2024-04-25T10:35:44.461294+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:46.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'26","reported_seq":53,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.587415+0000","last_change":"2024-04-25T10:35:33.587445+0000","last_active":"2024-04-25T10:35:33.587415+0000","last_peered":"2024-04-25T10:35:33.587415+0000","last_clean":"2024-04-25T10:35:33.587415+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:35:33.587415+0000","last_undegraded":"2024-04-25T10:35:33.587415+0000","last_fullsized":"2024-04-25T10:35:33.587415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'26","last_scrub_stamp":"2024-04-25T10:35:33.587316+0000","last_deep_scrub":"23'26","last_deep_scrub_stamp":"2024-04-25T10:35:33.587316+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.587316+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:41.932915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'15","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:24.061481+0000","last_change":"2024-04-25T10:33:43.186661+0000","last_active":"2024-04-25T10:35:24.061481+0000","last_peered":"2024-04-25T10:35:24.061481+0000","last_clean":"2024-04-25T10:35:24.061481+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:35:24.061481+0000","last_undegraded":"2024-04-25T10:35:24.061481+0000","last_fullsized":"2024-04-25T10:35:24.061481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:33:42.141119+0000","last_clean_scrub_stamp":"2024-04-25T10:33:42.141119+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.502258+0000","last_change":"2024-04-25T10:35:37.502289+0000","last_active":"2024-04-25T10:35:37.502258+0000","last_peered":"2024-04-25T10:35:37.502258+0000","last_clean":"2024-04-25T10:35:37.502258+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:35:37.502258+0000","last_undegraded":"2024-04-25T10:35:37.502258+0000","last_fullsized":"2024-04-25T10:35:37.502258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:37.502157+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:37.502157+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.502157+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:41.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'20","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.495245+0000","last_change":"2024-04-25T10:35:39.495277+0000","last_active":"2024-04-25T10:35:39.495245+0000","last_peered":"2024-04-25T10:35:39.495245+0000","last_clean":"2024-04-25T10:35:39.495245+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:35:39.495245+0000","last_undegraded":"2024-04-25T10:35:39.495245+0000","last_fullsized":"2024-04-25T10:35:39.495245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'20","last_scrub_stamp":"2024-04-25T10:35:39.495140+0000","last_deep_scrub":"23'20","last_deep_scrub_stamp":"2024-04-25T10:35:39.495140+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.495140+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:59.461951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'19","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:42.447991+0000","last_change":"2024-04-25T10:35:42.448047+0000","last_active":"2024-04-25T10:35:42.447991+0000","last_peered":"2024-04-25T10:35:42.447991+0000","last_clean":"2024-04-25T10:35:42.447991+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:35:42.447991+0000","last_undegraded":"2024-04-25T10:35:42.447991+0000","last_fullsized":"2024-04-25T10:35:42.447991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:42.447861+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:42.447861+0000","last_clean_scrub_stamp":"2024-04-25T10:35:42.447861+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:44.461800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'19","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.767617+0000","last_change":"2024-04-25T10:35:32.767671+0000","last_active":"2024-04-25T10:35:32.767617+0000","last_peered":"2024-04-25T10:35:32.767617+0000","last_clean":"2024-04-25T10:35:32.767617+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:35:32.767617+0000","last_undegraded":"2024-04-25T10:35:32.767617+0000","last_fullsized":"2024-04-25T10:35:32.767617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:32.767481+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:32.767481+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.767481+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:52.732585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'15","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:45.493610+0000","last_change":"2024-04-25T10:35:45.493640+0000","last_active":"2024-04-25T10:35:45.493610+0000","last_peered":"2024-04-25T10:35:45.493610+0000","last_clean":"2024-04-25T10:35:45.493610+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:35:45.493610+0000","last_undegraded":"2024-04-25T10:35:45.493610+0000","last_fullsized":"2024-04-25T10:35:45.493610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:45.493508+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:45.493508+0000","last_clean_scrub_stamp":"2024-04-25T10:35:45.493508+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:59.768500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'11","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.523756+0000","last_change":"2024-04-25T10:35:36.523786+0000","last_active":"2024-04-25T10:35:36.523756+0000","last_peered":"2024-04-25T10:35:36.523756+0000","last_clean":"2024-04-25T10:35:36.523756+0000","last_became_active":"2024-04-25T10:34:24.299359+0000","last_became_peered":"2024-04-25T10:34:24.299359+0000","last_unstale":"2024-04-25T10:35:36.523756+0000","last_undegraded":"2024-04-25T10:35:36.523756+0000","last_fullsized":"2024-04-25T10:35:36.523756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-04-25T10:35:36.523658+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-04-25T10:35:36.523658+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.523658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:35.717047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"23'23","reported_seq":50,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:41.485414+0000","last_change":"2024-04-25T10:35:41.485471+0000","last_active":"2024-04-25T10:35:41.485414+0000","last_peered":"2024-04-25T10:35:41.485414+0000","last_clean":"2024-04-25T10:35:41.485414+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:35:41.485414+0000","last_undegraded":"2024-04-25T10:35:41.485414+0000","last_fullsized":"2024-04-25T10:35:41.485414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23","last_scrub_stamp":"2024-04-25T10:35:41.485300+0000","last_deep_scrub":"23'23","last_deep_scrub_stamp":"2024-04-25T10:35:41.485300+0000","last_clean_scrub_stamp":"2024-04-25T10:35:41.485300+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:39.067925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'16","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.524807+0000","last_change":"2024-04-25T10:35:39.524839+0000","last_active":"2024-04-25T10:35:39.524807+0000","last_peered":"2024-04-25T10:35:39.524807+0000","last_clean":"2024-04-25T10:35:39.524807+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:35:39.524807+0000","last_undegraded":"2024-04-25T10:35:39.524807+0000","last_fullsized":"2024-04-25T10:35:39.524807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:39.524711+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:39.524711+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.524711+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:59.491521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.803589+0000","last_change":"2024-04-25T10:35:33.803639+0000","last_active":"2024-04-25T10:35:33.803589+0000","last_peered":"2024-04-25T10:35:33.803589+0000","last_clean":"2024-04-25T10:35:33.803589+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:35:33.803589+0000","last_undegraded":"2024-04-25T10:35:33.803589+0000","last_fullsized":"2024-04-25T10:35:33.803589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:33.803449+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:33.803449+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.803449+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:57.722376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.530052+0000","last_change":"2024-04-25T10:35:31.530088+0000","last_active":"2024-04-25T10:35:31.530052+0000","last_peered":"2024-04-25T10:35:31.530052+0000","last_clean":"2024-04-25T10:35:31.530052+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:35:31.530052+0000","last_undegraded":"2024-04-25T10:35:31.530052+0000","last_fullsized":"2024-04-25T10:35:31.530052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:31.529955+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:31.529955+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.529955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:53.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:43.438341+0000","last_change":"2024-04-25T10:35:43.438379+0000","last_active":"2024-04-25T10:35:43.438341+0000","last_peered":"2024-04-25T10:35:43.438341+0000","last_clean":"2024-04-25T10:35:43.438341+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:35:43.438341+0000","last_undegraded":"2024-04-25T10:35:43.438341+0000","last_fullsized":"2024-04-25T10:35:43.438341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:43.438213+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:43.438213+0000","last_clean_scrub_stamp":"2024-04-25T10:35:43.438213+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.731847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'19","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.600881+0000","last_change":"2024-04-25T10:35:32.600913+0000","last_active":"2024-04-25T10:35:32.600881+0000","last_peered":"2024-04-25T10:35:32.600881+0000","last_clean":"2024-04-25T10:35:32.600881+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:35:32.600881+0000","last_undegraded":"2024-04-25T10:35:32.600881+0000","last_fullsized":"2024-04-25T10:35:32.600881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:32.600782+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:32.600782+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.600782+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:54.932750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:40.508682+0000","last_change":"2024-04-25T10:35:40.508714+0000","last_active":"2024-04-25T10:35:40.508682+0000","last_peered":"2024-04-25T10:35:40.508682+0000","last_clean":"2024-04-25T10:35:40.508682+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:35:40.508682+0000","last_undegraded":"2024-04-25T10:35:40.508682+0000","last_fullsized":"2024-04-25T10:35:40.508682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:40.508587+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:40.508587+0000","last_clean_scrub_stamp":"2024-04-25T10:35:40.508587+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:25.432389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.644365+0000","last_change":"2024-04-25T10:35:31.644392+0000","last_active":"2024-04-25T10:35:31.644365+0000","last_peered":"2024-04-25T10:35:31.644365+0000","last_clean":"2024-04-25T10:35:31.644365+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:35:31.644365+0000","last_undegraded":"2024-04-25T10:35:31.644365+0000","last_fullsized":"2024-04-25T10:35:31.644365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:31.644265+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:31.644265+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.644265+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:11.124923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.746883+0000","last_change":"2024-04-25T10:35:31.746931+0000","last_active":"2024-04-25T10:35:31.746883+0000","last_peered":"2024-04-25T10:35:31.746883+0000","last_clean":"2024-04-25T10:35:31.746883+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:35:31.746883+0000","last_undegraded":"2024-04-25T10:35:31.746883+0000","last_fullsized":"2024-04-25T10:35:31.746883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-25T10:35:31.746785+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-25T10:35:31.746785+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.746785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:26.011558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.577886+0000","last_change":"2024-04-25T10:35:32.577967+0000","last_active":"2024-04-25T10:35:32.577886+0000","last_peered":"2024-04-25T10:35:32.577886+0000","last_clean":"2024-04-25T10:35:32.577886+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:35:32.577886+0000","last_undegraded":"2024-04-25T10:35:32.577886+0000","last_fullsized":"2024-04-25T10:35:32.577886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:32.577754+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:32.577754+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.577754+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:31.368014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.526764+0000","last_change":"2024-04-25T10:35:31.526812+0000","last_active":"2024-04-25T10:35:31.526764+0000","last_peered":"2024-04-25T10:35:31.526764+0000","last_clean":"2024-04-25T10:35:31.526764+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:35:31.526764+0000","last_undegraded":"2024-04-25T10:35:31.526764+0000","last_fullsized":"2024-04-25T10:35:31.526764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-25T10:35:31.526660+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-25T10:35:31.526660+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.526660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:33.671141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.746982+0000","last_change":"2024-04-25T10:35:29.747023+0000","last_active":"2024-04-25T10:35:29.746982+0000","last_peered":"2024-04-25T10:35:29.746982+0000","last_clean":"2024-04-25T10:35:29.746982+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:35:29.746982+0000","last_undegraded":"2024-04-25T10:35:29.746982+0000","last_fullsized":"2024-04-25T10:35:29.746982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:29.746859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:29.746859+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.746859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:31.891340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.876464+0000","last_change":"2024-04-25T10:35:37.876506+0000","last_active":"2024-04-25T10:35:37.876464+0000","last_peered":"2024-04-25T10:35:37.876464+0000","last_clean":"2024-04-25T10:35:37.876464+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:35:37.876464+0000","last_undegraded":"2024-04-25T10:35:37.876464+0000","last_fullsized":"2024-04-25T10:35:37.876464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:37.876354+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:37.876354+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.876354+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:11.188146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.299862+0000","last_change":"2024-04-25T10:35:31.299908+0000","last_active":"2024-04-25T10:35:31.299862+0000","last_peered":"2024-04-25T10:35:31.299862+0000","last_clean":"2024-04-25T10:35:31.299862+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:35:31.299862+0000","last_undegraded":"2024-04-25T10:35:31.299862+0000","last_fullsized":"2024-04-25T10:35:31.299862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:31.299712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:31.299712+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.299712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:55.218639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.504655+0000","last_change":"2024-04-25T10:35:38.504689+0000","last_active":"2024-04-25T10:35:38.504655+0000","last_peered":"2024-04-25T10:35:38.504655+0000","last_clean":"2024-04-25T10:35:38.504655+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:35:38.504655+0000","last_undegraded":"2024-04-25T10:35:38.504655+0000","last_fullsized":"2024-04-25T10:35:38.504655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:38.504541+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:38.504541+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.504541+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:35.328438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.502057+0000","last_change":"2024-04-25T10:35:32.502132+0000","last_active":"2024-04-25T10:35:32.502057+0000","last_peered":"2024-04-25T10:35:32.502057+0000","last_clean":"2024-04-25T10:35:32.502057+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:35:32.502057+0000","last_undegraded":"2024-04-25T10:35:32.502057+0000","last_fullsized":"2024-04-25T10:35:32.502057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-25T10:35:32.501920+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-25T10:35:32.501920+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.501920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:26.305045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:40.391805+0000","last_change":"2024-04-25T10:35:40.391861+0000","last_active":"2024-04-25T10:35:40.391805+0000","last_peered":"2024-04-25T10:35:40.391805+0000","last_clean":"2024-04-25T10:35:40.391805+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:35:40.391805+0000","last_undegraded":"2024-04-25T10:35:40.391805+0000","last_fullsized":"2024-04-25T10:35:40.391805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:40.391659+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:40.391659+0000","last_clean_scrub_stamp":"2024-04-25T10:35:40.391659+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:42.203453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.303723+0000","last_change":"2024-04-25T10:35:34.303781+0000","last_active":"2024-04-25T10:35:34.303723+0000","last_peered":"2024-04-25T10:35:34.303723+0000","last_clean":"2024-04-25T10:35:34.303723+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:35:34.303723+0000","last_undegraded":"2024-04-25T10:35:34.303723+0000","last_fullsized":"2024-04-25T10:35:34.303723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:34.303599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:34.303599+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.303599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:31.127496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.611721+0000","last_change":"2024-04-25T10:35:33.611815+0000","last_active":"2024-04-25T10:35:33.611721+0000","last_peered":"2024-04-25T10:35:33.611721+0000","last_clean":"2024-04-25T10:35:33.611721+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:35:33.611721+0000","last_undegraded":"2024-04-25T10:35:33.611721+0000","last_fullsized":"2024-04-25T10:35:33.611721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:33.611599+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:33.611599+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.611599+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:52.031610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'7","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.521930+0000","last_change":"2024-04-25T10:35:31.521997+0000","last_active":"2024-04-25T10:35:31.521930+0000","last_peered":"2024-04-25T10:35:31.521930+0000","last_clean":"2024-04-25T10:35:31.521930+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:35:31.521930+0000","last_undegraded":"2024-04-25T10:35:31.521930+0000","last_fullsized":"2024-04-25T10:35:31.521930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-04-25T10:35:31.521813+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-04-25T10:35:31.521813+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.521813+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:53.043279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'19","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.627867+0000","last_change":"2024-04-25T10:35:34.627895+0000","last_active":"2024-04-25T10:35:34.627867+0000","last_peered":"2024-04-25T10:35:34.627867+0000","last_clean":"2024-04-25T10:35:34.627867+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:35:34.627867+0000","last_undegraded":"2024-04-25T10:35:34.627867+0000","last_fullsized":"2024-04-25T10:35:34.627867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:34.627760+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:34.627760+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.627760+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:00.772977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'118","reported_seq":147,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.482210+0000","last_change":"2024-04-25T10:35:30.482250+0000","last_active":"2024-04-25T10:35:30.482210+0000","last_peered":"2024-04-25T10:35:30.482210+0000","last_clean":"2024-04-25T10:35:30.482210+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:35:30.482210+0000","last_undegraded":"2024-04-25T10:35:30.482210+0000","last_fullsized":"2024-04-25T10:35:30.482210+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'118","last_scrub_stamp":"2024-04-25T10:35:30.482114+0000","last_deep_scrub":"23'118","last_deep_scrub_stamp":"2024-04-25T10:35:30.482114+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.482114+0000","objects_scrubbed":4,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:32.604791+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149769,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.846297+0000","last_change":"2024-04-25T10:35:39.846357+0000","last_active":"2024-04-25T10:35:39.846297+0000","last_peered":"2024-04-25T10:35:39.846297+0000","last_clean":"2024-04-25T10:35:39.846297+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:35:39.846297+0000","last_undegraded":"2024-04-25T10:35:39.846297+0000","last_fullsized":"2024-04-25T10:35:39.846297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:39.846180+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:39.846180+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.846180+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:09.909957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'5","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:28.509408+0000","last_change":"2024-04-25T10:35:28.509479+0000","last_active":"2024-04-25T10:35:28.509408+0000","last_peered":"2024-04-25T10:35:28.509408+0000","last_clean":"2024-04-25T10:35:28.509408+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:35:28.509408+0000","last_undegraded":"2024-04-25T10:35:28.509408+0000","last_fullsized":"2024-04-25T10:35:28.509408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-04-25T10:35:28.509276+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-04-25T10:35:28.509276+0000","last_clean_scrub_stamp":"2024-04-25T10:35:28.509276+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:08.262016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'19","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.457573+0000","last_change":"2024-04-25T10:35:38.457628+0000","last_active":"2024-04-25T10:35:38.457573+0000","last_peered":"2024-04-25T10:35:38.457573+0000","last_clean":"2024-04-25T10:35:38.457573+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:35:38.457573+0000","last_undegraded":"2024-04-25T10:35:38.457573+0000","last_fullsized":"2024-04-25T10:35:38.457573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:38.457433+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:38.457433+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.457433+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:35.281330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.280659+0000","last_change":"2024-04-25T10:35:32.280694+0000","last_active":"2024-04-25T10:35:32.280659+0000","last_peered":"2024-04-25T10:35:32.280659+0000","last_clean":"2024-04-25T10:35:32.280659+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:35:32.280659+0000","last_undegraded":"2024-04-25T10:35:32.280659+0000","last_fullsized":"2024-04-25T10:35:32.280659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:32.280528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:32.280528+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.280528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:30.220799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'27","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:42.877028+0000","last_change":"2024-04-25T10:35:42.877058+0000","last_active":"2024-04-25T10:35:42.877028+0000","last_peered":"2024-04-25T10:35:42.877028+0000","last_clean":"2024-04-25T10:35:42.877028+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:35:42.877028+0000","last_undegraded":"2024-04-25T10:35:42.877028+0000","last_fullsized":"2024-04-25T10:35:42.877028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'27","last_scrub_stamp":"2024-04-25T10:35:42.876913+0000","last_deep_scrub":"23'27","last_deep_scrub_stamp":"2024-04-25T10:35:42.876913+0000","last_clean_scrub_stamp":"2024-04-25T10:35:42.876913+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:47.034570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.508983+0000","last_change":"2024-04-25T10:35:34.509026+0000","last_active":"2024-04-25T10:35:34.508983+0000","last_peered":"2024-04-25T10:35:34.508983+0000","last_clean":"2024-04-25T10:35:34.508983+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:35:34.508983+0000","last_undegraded":"2024-04-25T10:35:34.508983+0000","last_fullsized":"2024-04-25T10:35:34.508983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:34.508877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:34.508877+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.508877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:33.702266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'15","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.467683+0000","last_change":"2024-04-25T10:35:39.467731+0000","last_active":"2024-04-25T10:35:39.467683+0000","last_peered":"2024-04-25T10:35:39.467683+0000","last_clean":"2024-04-25T10:35:39.467683+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:35:39.467683+0000","last_undegraded":"2024-04-25T10:35:39.467683+0000","last_fullsized":"2024-04-25T10:35:39.467683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:39.467586+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:39.467586+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.467586+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:12.779378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'12","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:28.688793+0000","last_change":"2024-04-25T10:35:28.688829+0000","last_active":"2024-04-25T10:35:28.688793+0000","last_peered":"2024-04-25T10:35:28.688793+0000","last_clean":"2024-04-25T10:35:28.688793+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:35:28.688793+0000","last_undegraded":"2024-04-25T10:35:28.688793+0000","last_fullsized":"2024-04-25T10:35:28.688793+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-04-25T10:35:28.688706+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-04-25T10:35:28.688706+0000","last_clean_scrub_stamp":"2024-04-25T10:35:28.688706+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:08.169364+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:41.881602+0000","last_change":"2024-04-25T10:35:41.881633+0000","last_active":"2024-04-25T10:35:41.881602+0000","last_peered":"2024-04-25T10:35:41.881602+0000","last_clean":"2024-04-25T10:35:41.881602+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:35:41.881602+0000","last_undegraded":"2024-04-25T10:35:41.881602+0000","last_fullsized":"2024-04-25T10:35:41.881602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:41.881498+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:41.881498+0000","last_clean_scrub_stamp":"2024-04-25T10:35:41.881498+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:41.676941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.574024+0000","last_change":"2024-04-25T10:35:29.574075+0000","last_active":"2024-04-25T10:35:29.574024+0000","last_peered":"2024-04-25T10:35:29.574024+0000","last_clean":"2024-04-25T10:35:29.574024+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:35:29.574024+0000","last_undegraded":"2024-04-25T10:35:29.574024+0000","last_fullsized":"2024-04-25T10:35:29.574024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-04-25T10:35:29.573923+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-04-25T10:35:29.573923+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.573923+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:03.854727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'12","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.592509+0000","last_change":"2024-04-25T10:35:34.592569+0000","last_active":"2024-04-25T10:35:34.592509+0000","last_peered":"2024-04-25T10:35:34.592509+0000","last_clean":"2024-04-25T10:35:34.592509+0000","last_became_active":"2024-04-25T10:34:24.298059+0000","last_became_peered":"2024-04-25T10:34:24.298059+0000","last_unstale":"2024-04-25T10:35:34.592509+0000","last_undegraded":"2024-04-25T10:35:34.592509+0000","last_fullsized":"2024-04-25T10:35:34.592509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-04-25T10:35:34.592355+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-04-25T10:35:34.592355+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.592355+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:56.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.683233+0000","last_change":"2024-04-25T10:35:29.683269+0000","last_active":"2024-04-25T10:35:29.683233+0000","last_peered":"2024-04-25T10:35:29.683233+0000","last_clean":"2024-04-25T10:35:29.683233+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:35:29.683233+0000","last_undegraded":"2024-04-25T10:35:29.683233+0000","last_fullsized":"2024-04-25T10:35:29.683233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-04-25T10:35:29.683135+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-04-25T10:35:29.683135+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.683135+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:18.672756+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:44.821697+0000","last_change":"2024-04-25T10:35:44.821749+0000","last_active":"2024-04-25T10:35:44.821697+0000","last_peered":"2024-04-25T10:35:44.821697+0000","last_clean":"2024-04-25T10:35:44.821697+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:35:44.821697+0000","last_undegraded":"2024-04-25T10:35:44.821697+0000","last_fullsized":"2024-04-25T10:35:44.821697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:44.821550+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:44.821550+0000","last_clean_scrub_stamp":"2024-04-25T10:35:44.821550+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:32.713374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'2","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:28.511647+0000","last_change":"2024-04-25T10:35:28.511683+0000","last_active":"2024-04-25T10:35:28.511647+0000","last_peered":"2024-04-25T10:35:28.511647+0000","last_clean":"2024-04-25T10:35:28.511647+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:35:28.511647+0000","last_undegraded":"2024-04-25T10:35:28.511647+0000","last_fullsized":"2024-04-25T10:35:28.511647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-04-25T10:35:28.511559+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-04-25T10:35:28.511559+0000","last_clean_scrub_stamp":"2024-04-25T10:35:28.511559+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:08.264299+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'18","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.549175+0000","last_change":"2024-04-25T10:35:35.549208+0000","last_active":"2024-04-25T10:35:35.549175+0000","last_peered":"2024-04-25T10:35:35.549175+0000","last_clean":"2024-04-25T10:35:35.549175+0000","last_became_active":"2024-04-25T10:34:24.299411+0000","last_became_peered":"2024-04-25T10:34:24.299411+0000","last_unstale":"2024-04-25T10:35:35.549175+0000","last_undegraded":"2024-04-25T10:35:35.549175+0000","last_fullsized":"2024-04-25T10:35:35.549175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:35.549069+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:35.549069+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.549069+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:34.339329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.640267+0000","last_change":"2024-04-25T10:35:31.640288+0000","last_active":"2024-04-25T10:35:31.640267+0000","last_peered":"2024-04-25T10:35:31.640267+0000","last_clean":"2024-04-25T10:35:31.640267+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:35:31.640267+0000","last_undegraded":"2024-04-25T10:35:31.640267+0000","last_fullsized":"2024-04-25T10:35:31.640267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:31.640154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:31.640154+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.640154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:54.212979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'15","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:43.860586+0000","last_change":"2024-04-25T10:35:43.860617+0000","last_active":"2024-04-25T10:35:43.860586+0000","last_peered":"2024-04-25T10:35:43.860586+0000","last_clean":"2024-04-25T10:35:43.860586+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:35:43.860586+0000","last_undegraded":"2024-04-25T10:35:43.860586+0000","last_fullsized":"2024-04-25T10:35:43.860586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:43.860478+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:43.860478+0000","last_clean_scrub_stamp":"2024-04-25T10:35:43.860478+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:50.873543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'74","reported_seq":128,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.722189+0000","last_change":"2024-04-25T10:35:32.722189+0000","last_active":"2024-04-25T10:35:32.722189+0000","last_peered":"2024-04-25T10:35:32.722189+0000","last_clean":"2024-04-25T10:35:32.722189+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:35:32.722189+0000","last_undegraded":"2024-04-25T10:35:32.722189+0000","last_fullsized":"2024-04-25T10:35:32.722189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-04-25T10:35:32.722036+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-04-25T10:35:32.722036+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.722036+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:29.545933+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.312434+0000","last_change":"2024-04-25T10:35:33.312496+0000","last_active":"2024-04-25T10:35:33.312434+0000","last_peered":"2024-04-25T10:35:33.312434+0000","last_clean":"2024-04-25T10:35:33.312434+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:35:33.312434+0000","last_undegraded":"2024-04-25T10:35:33.312434+0000","last_fullsized":"2024-04-25T10:35:33.312434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:33.312288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:33.312288+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.312288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:36.961296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.844664+0000","last_change":"2024-04-25T10:35:36.844735+0000","last_active":"2024-04-25T10:35:36.844664+0000","last_peered":"2024-04-25T10:35:36.844664+0000","last_clean":"2024-04-25T10:35:36.844664+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:35:36.844664+0000","last_undegraded":"2024-04-25T10:35:36.844664+0000","last_fullsized":"2024-04-25T10:35:36.844664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:36.844540+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:36.844540+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.844540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:17.330692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.738221+0000","last_change":"2024-04-25T10:35:33.738221+0000","last_active":"2024-04-25T10:35:33.738221+0000","last_peered":"2024-04-25T10:35:33.738221+0000","last_clean":"2024-04-25T10:35:33.738221+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:35:33.738221+0000","last_undegraded":"2024-04-25T10:35:33.738221+0000","last_fullsized":"2024-04-25T10:35:33.738221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:33.738035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:33.738035+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.738035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:53.704846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.481836+0000","last_change":"2024-04-25T10:35:30.481883+0000","last_active":"2024-04-25T10:35:30.481836+0000","last_peered":"2024-04-25T10:35:30.481836+0000","last_clean":"2024-04-25T10:35:30.481836+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:35:30.481836+0000","last_undegraded":"2024-04-25T10:35:30.481836+0000","last_fullsized":"2024-04-25T10:35:30.481836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:30.481718+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:30.481718+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.481718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:38.827316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'4","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.644131+0000","last_change":"2024-04-25T10:35:30.644177+0000","last_active":"2024-04-25T10:35:30.644131+0000","last_peered":"2024-04-25T10:35:30.644131+0000","last_clean":"2024-04-25T10:35:30.644131+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:35:30.644131+0000","last_undegraded":"2024-04-25T10:35:30.644131+0000","last_fullsized":"2024-04-25T10:35:30.644131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-04-25T10:35:30.643989+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-04-25T10:35:30.643989+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.643989+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:23.642545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1111,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'21","reported_seq":49,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.422129+0000","last_change":"2024-04-25T10:35:36.422129+0000","last_active":"2024-04-25T10:35:36.422129+0000","last_peered":"2024-04-25T10:35:36.422129+0000","last_clean":"2024-04-25T10:35:36.422129+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:35:36.422129+0000","last_undegraded":"2024-04-25T10:35:36.422129+0000","last_fullsized":"2024-04-25T10:35:36.422129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'21","last_scrub_stamp":"2024-04-25T10:35:36.421981+0000","last_deep_scrub":"23'21","last_deep_scrub_stamp":"2024-04-25T10:35:36.421981+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.421981+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:00.599414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.318042+0000","last_change":"2024-04-25T10:35:30.318072+0000","last_active":"2024-04-25T10:35:30.318042+0000","last_peered":"2024-04-25T10:35:30.318042+0000","last_clean":"2024-04-25T10:35:30.318042+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:35:30.318042+0000","last_undegraded":"2024-04-25T10:35:30.318042+0000","last_fullsized":"2024-04-25T10:35:30.318042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-04-25T10:35:30.317936+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-04-25T10:35:30.317936+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.317936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:50.283040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'11","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.690540+0000","last_change":"2024-04-25T10:35:32.690584+0000","last_active":"2024-04-25T10:35:32.690540+0000","last_peered":"2024-04-25T10:35:32.690540+0000","last_clean":"2024-04-25T10:35:32.690540+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:35:32.690540+0000","last_undegraded":"2024-04-25T10:35:32.690540+0000","last_fullsized":"2024-04-25T10:35:32.690540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-04-25T10:35:32.690428+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-04-25T10:35:32.690428+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.690428+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:10.306243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.479445+0000","last_change":"2024-04-25T10:35:32.479478+0000","last_active":"2024-04-25T10:35:32.479445+0000","last_peered":"2024-04-25T10:35:32.479445+0000","last_clean":"2024-04-25T10:35:32.479445+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:35:32.479445+0000","last_undegraded":"2024-04-25T10:35:32.479445+0000","last_fullsized":"2024-04-25T10:35:32.479445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:32.479336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:32.479336+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.479336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:31.269596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'13","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.356432+0000","last_change":"2024-04-25T10:35:37.356463+0000","last_active":"2024-04-25T10:35:37.356432+0000","last_peered":"2024-04-25T10:35:37.356432+0000","last_clean":"2024-04-25T10:35:37.356432+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:35:37.356432+0000","last_undegraded":"2024-04-25T10:35:37.356432+0000","last_fullsized":"2024-04-25T10:35:37.356432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-04-25T10:35:37.356334+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-04-25T10:35:37.356334+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.356334+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:21.203163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.842131+0000","last_change":"2024-04-25T10:35:37.842174+0000","last_active":"2024-04-25T10:35:37.842131+0000","last_peered":"2024-04-25T10:35:37.842131+0000","last_clean":"2024-04-25T10:35:37.842131+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:35:37.842131+0000","last_undegraded":"2024-04-25T10:35:37.842131+0000","last_fullsized":"2024-04-25T10:35:37.842131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:37.842019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:37.842019+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.842019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:37.509353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'16","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.414031+0000","last_change":"2024-04-25T10:35:34.414081+0000","last_active":"2024-04-25T10:35:34.414031+0000","last_peered":"2024-04-25T10:35:34.414031+0000","last_clean":"2024-04-25T10:35:34.414031+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:35:34.414031+0000","last_undegraded":"2024-04-25T10:35:34.414031+0000","last_fullsized":"2024-04-25T10:35:34.414031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:34.413916+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:34.413916+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.413916+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:36.557654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'6","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.511303+0000","last_change":"2024-04-25T10:35:30.511357+0000","last_active":"2024-04-25T10:35:30.511303+0000","last_peered":"2024-04-25T10:35:30.511303+0000","last_clean":"2024-04-25T10:35:30.511303+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:35:30.511303+0000","last_undegraded":"2024-04-25T10:35:30.511303+0000","last_fullsized":"2024-04-25T10:35:30.511303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-04-25T10:35:30.511205+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-04-25T10:35:30.511205+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.511205+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:38.856803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'15","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:41.812519+0000","last_change":"2024-04-25T10:35:41.812553+0000","last_active":"2024-04-25T10:35:41.812519+0000","last_peered":"2024-04-25T10:35:41.812519+0000","last_clean":"2024-04-25T10:35:41.812519+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:35:41.812519+0000","last_undegraded":"2024-04-25T10:35:41.812519+0000","last_fullsized":"2024-04-25T10:35:41.812519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:41.812389+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:41.812389+0000","last_clean_scrub_stamp":"2024-04-25T10:35:41.812389+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:23.257594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.489043+0000","last_change":"2024-04-25T10:35:33.489079+0000","last_active":"2024-04-25T10:35:33.489043+0000","last_peered":"2024-04-25T10:35:33.489043+0000","last_clean":"2024-04-25T10:35:33.489043+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:35:33.489043+0000","last_undegraded":"2024-04-25T10:35:33.489043+0000","last_fullsized":"2024-04-25T10:35:33.489043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-04-25T10:35:33.488949+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-04-25T10:35:33.488949+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.488949+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:27.753722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'19","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.569176+0000","last_change":"2024-04-25T10:35:35.569243+0000","last_active":"2024-04-25T10:35:35.569176+0000","last_peered":"2024-04-25T10:35:35.569176+0000","last_clean":"2024-04-25T10:35:35.569176+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:35:35.569176+0000","last_undegraded":"2024-04-25T10:35:35.569176+0000","last_fullsized":"2024-04-25T10:35:35.569176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:35.569057+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:35.569057+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.569057+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:58.288488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.751380+0000","last_change":"2024-04-25T10:35:34.751432+0000","last_active":"2024-04-25T10:35:34.751380+0000","last_peered":"2024-04-25T10:35:34.751380+0000","last_clean":"2024-04-25T10:35:34.751380+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:35:34.751380+0000","last_undegraded":"2024-04-25T10:35:34.751380+0000","last_fullsized":"2024-04-25T10:35:34.751380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:34.751247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:34.751247+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.751247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:32.333872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'7","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.600668+0000","last_change":"2024-04-25T10:35:30.600720+0000","last_active":"2024-04-25T10:35:30.600668+0000","last_peered":"2024-04-25T10:35:30.600668+0000","last_clean":"2024-04-25T10:35:30.600668+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:35:30.600668+0000","last_undegraded":"2024-04-25T10:35:30.600668+0000","last_fullsized":"2024-04-25T10:35:30.600668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-04-25T10:35:30.600541+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-04-25T10:35:30.600541+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.600541+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:23.775430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.448267+0000","last_change":"2024-04-25T10:35:33.448309+0000","last_active":"2024-04-25T10:35:33.448267+0000","last_peered":"2024-04-25T10:35:33.448267+0000","last_clean":"2024-04-25T10:35:33.448267+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:35:33.448267+0000","last_undegraded":"2024-04-25T10:35:33.448267+0000","last_fullsized":"2024-04-25T10:35:33.448267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:33.448162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:33.448162+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.448162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:51.868172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'16","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.808232+0000","last_change":"2024-04-25T10:35:35.808266+0000","last_active":"2024-04-25T10:35:35.808232+0000","last_peered":"2024-04-25T10:35:35.808232+0000","last_clean":"2024-04-25T10:35:35.808232+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:35:35.808232+0000","last_undegraded":"2024-04-25T10:35:35.808232+0000","last_fullsized":"2024-04-25T10:35:35.808232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:35.808128+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:35.808128+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.808128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:43.070075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.552903+0000","last_change":"2024-04-25T10:35:29.552926+0000","last_active":"2024-04-25T10:35:29.552903+0000","last_peered":"2024-04-25T10:35:29.552903+0000","last_clean":"2024-04-25T10:35:29.552903+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:35:29.552903+0000","last_undegraded":"2024-04-25T10:35:29.552903+0000","last_fullsized":"2024-04-25T10:35:29.552903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:29.552814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:29.552814+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.552814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:55.698031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.795146+0000","last_change":"2024-04-25T10:35:34.795209+0000","last_active":"2024-04-25T10:35:34.795146+0000","last_peered":"2024-04-25T10:35:34.795146+0000","last_clean":"2024-04-25T10:35:34.795146+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:35:34.795146+0000","last_undegraded":"2024-04-25T10:35:34.795146+0000","last_fullsized":"2024-04-25T10:35:34.795146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:34.795026+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:34.795026+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.795026+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:32.735298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.802112+0000","last_change":"2024-04-25T10:35:36.802149+0000","last_active":"2024-04-25T10:35:36.802112+0000","last_peered":"2024-04-25T10:35:36.802112+0000","last_clean":"2024-04-25T10:35:36.802112+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:35:36.802112+0000","last_undegraded":"2024-04-25T10:35:36.802112+0000","last_fullsized":"2024-04-25T10:35:36.802112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-04-25T10:35:36.802012+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-04-25T10:35:36.802012+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.802012+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:43.221645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.502145+0000","last_change":"2024-04-25T10:35:35.502174+0000","last_active":"2024-04-25T10:35:35.502145+0000","last_peered":"2024-04-25T10:35:35.502145+0000","last_clean":"2024-04-25T10:35:35.502145+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:35:35.502145+0000","last_undegraded":"2024-04-25T10:35:35.502145+0000","last_fullsized":"2024-04-25T10:35:35.502145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:35.502032+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:35.502032+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.502032+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:59.420959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'23","reported_seq":50,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:41.409149+0000","last_change":"2024-04-25T10:35:41.409203+0000","last_active":"2024-04-25T10:35:41.409149+0000","last_peered":"2024-04-25T10:35:41.409149+0000","last_clean":"2024-04-25T10:35:41.409149+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:35:41.409149+0000","last_undegraded":"2024-04-25T10:35:41.409149+0000","last_fullsized":"2024-04-25T10:35:41.409149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23","last_scrub_stamp":"2024-04-25T10:35:41.409025+0000","last_deep_scrub":"23'23","last_deep_scrub_stamp":"2024-04-25T10:35:41.409025+0000","last_clean_scrub_stamp":"2024-04-25T10:35:41.409025+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:42.011099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.791640+0000","last_change":"2024-04-25T10:35:35.791678+0000","last_active":"2024-04-25T10:35:35.791640+0000","last_peered":"2024-04-25T10:35:35.791640+0000","last_clean":"2024-04-25T10:35:35.791640+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:35:35.791640+0000","last_undegraded":"2024-04-25T10:35:35.791640+0000","last_fullsized":"2024-04-25T10:35:35.791640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-04-25T10:35:35.791538+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-04-25T10:35:35.791538+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.791538+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:51.091506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'13","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.333974+0000","last_change":"2024-04-25T10:35:35.334021+0000","last_active":"2024-04-25T10:35:35.333974+0000","last_peered":"2024-04-25T10:35:35.333974+0000","last_clean":"2024-04-25T10:35:35.333974+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:35:35.333974+0000","last_undegraded":"2024-04-25T10:35:35.333974+0000","last_fullsized":"2024-04-25T10:35:35.333974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-04-25T10:35:35.333820+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-04-25T10:35:35.333820+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.333820+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:55.300630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.832002+0000","last_change":"2024-04-25T10:35:38.832049+0000","last_active":"2024-04-25T10:35:38.832002+0000","last_peered":"2024-04-25T10:35:38.832002+0000","last_clean":"2024-04-25T10:35:38.832002+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:35:38.832002+0000","last_undegraded":"2024-04-25T10:35:38.832002+0000","last_fullsized":"2024-04-25T10:35:38.832002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-04-25T10:35:38.831897+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-04-25T10:35:38.831897+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.831897+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:28.622701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'16","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.583210+0000","last_change":"2024-04-25T10:35:34.583242+0000","last_active":"2024-04-25T10:35:34.583210+0000","last_peered":"2024-04-25T10:35:34.583210+0000","last_clean":"2024-04-25T10:35:34.583210+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:35:34.583210+0000","last_undegraded":"2024-04-25T10:35:34.583210+0000","last_fullsized":"2024-04-25T10:35:34.583210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:34.583103+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:34.583103+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.583103+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:36.726841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.778041+0000","last_change":"2024-04-25T10:35:30.778041+0000","last_active":"2024-04-25T10:35:30.778041+0000","last_peered":"2024-04-25T10:35:30.778041+0000","last_clean":"2024-04-25T10:35:30.778041+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:35:30.778041+0000","last_undegraded":"2024-04-25T10:35:30.778041+0000","last_fullsized":"2024-04-25T10:35:30.778041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-25T10:35:30.777933+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-25T10:35:30.777933+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.777933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:24.581058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'11","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.823633+0000","last_change":"2024-04-25T10:35:39.823633+0000","last_active":"2024-04-25T10:35:39.823633+0000","last_peered":"2024-04-25T10:35:39.823633+0000","last_clean":"2024-04-25T10:35:39.823633+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:35:39.823633+0000","last_undegraded":"2024-04-25T10:35:39.823633+0000","last_fullsized":"2024-04-25T10:35:39.823633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-04-25T10:35:39.823422+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-04-25T10:35:39.823422+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.823422+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:23.670251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'6","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.510726+0000","last_change":"2024-04-25T10:35:29.510754+0000","last_active":"2024-04-25T10:35:29.510726+0000","last_peered":"2024-04-25T10:35:29.510726+0000","last_clean":"2024-04-25T10:35:29.510726+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:35:29.510726+0000","last_undegraded":"2024-04-25T10:35:29.510726+0000","last_fullsized":"2024-04-25T10:35:29.510726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-04-25T10:35:29.510650+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-04-25T10:35:29.510650+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.510650+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:55.655868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":42,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":151678,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":167,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":303356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":851968,"data_stored":680186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":238996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":89320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":89356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":240116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":90344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":89393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":680239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":150880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":149769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:35:51.505 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:51.505 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:51.505 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T10:33:42.141119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=33, tm_sec=42, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=35, tm_sec=26, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:35:51.506 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T10:36:11.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:36:11.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.627+0000 7f36b4fc0640 1 Processor -- start 2024-04-25T10:36:11.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.627+0000 7f36b4fc0640 1 -- start start 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36b4fc0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b0149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36b4fc0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36b006d2d0 0x7f36b006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36b4fc0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b00bda00 con 0x7f36b00be4c0 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36b4fc0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f36b00be030 con 0x7f36b006d2d0 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36b4fc0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f36b01499c0 con 0x7f36b0143960 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36add9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f36b00be4c0 0x7f36b00bbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60594/0 (socket says 172.21.15.103:60594) 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36add9b640 1 -- 172.21.15.103:0/2955591691 learned_addr learned my addr 172.21.15.103:0/2955591691 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36aed9d640 1 --2- 172.21.15.103:0/2955591691 >> v2:172.21.15.132:3300/0 conn(0x7f36b006d2d0 0x7f36b006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36ae59c640 1 --2- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b0149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36ad59a640 1 -- 172.21.15.103:0/2955591691 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638278949 0 0) 0x7f36b00bda00 con 0x7f36b00be4c0 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36ad59a640 1 -- 172.21.15.103:0/2955591691 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3698003520 con 0x7f36b00be4c0 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36ad59a640 1 -- 172.21.15.103:0/2955591691 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2061421163 0 0) 0x7f3698003520 con 0x7f36b00be4c0 2024-04-25T10:36:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36aed9d640 1 -- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 msgr2=0x7f36b0149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36aed9d640 1 --2- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b0149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36aed9d640 1 -- 172.21.15.103:0/2955591691 >> v1:172.21.15.103:6789/0 conn(0x7f36b00be4c0 legacy=0x7f36b00bbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36aed9d640 1 -- 172.21.15.103:0/2955591691 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b00bdcc0 con 0x7f36b006d2d0 2024-04-25T10:36:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.629+0000 7f36ae59c640 1 --2- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b0149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:36:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.630+0000 7f36aed9d640 1 --2- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 0x7f36b006d6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36a80097a0 tx=0x7f36a802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c56b4c0ef8f30454 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.630+0000 7f36ad59a640 1 -- 172.21.15.103:0/2955591691 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8037070 con 0x7f36b006d2d0 2024-04-25T10:36:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.630+0000 7f36ad59a640 1 -- 172.21.15.103:0/2955591691 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a802ab10 con 0x7f36b006d2d0 2024-04-25T10:36:11.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.630+0000 7f36ad59a640 1 -- 172.21.15.103:0/2955591691 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4001670 con 0x7f36b006d2d0 2024-04-25T10:36:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.631+0000 7f36b4fc0640 1 -- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 msgr2=0x7f36b006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.631+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 0x7f36b006d6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36a80097a0 tx=0x7f36a802a080 comp rx=0 tx=0).stop 2024-04-25T10:36:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.631+0000 7f36b4fc0640 1 -- 172.21.15.103:0/2955591691 shutdown_connections 2024-04-25T10:36:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.631+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 0x7f36b006d6e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.631+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/2955591691 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b0149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.631+0000 7f36b4fc0640 1 -- 172.21.15.103:0/2955591691 >> 172.21.15.103:0/2955591691 conn(0x7f36b00befa0 msgr2=0x7f36b00bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.631+0000 7f36b4fc0640 1 -- 172.21.15.103:0/2955591691 shutdown_connections 2024-04-25T10:36:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.631+0000 7f36b4fc0640 1 -- 172.21.15.103:0/2955591691 wait complete. 2024-04-25T10:36:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.633+0000 7f36b4fc0640 1 Processor -- start 2024-04-25T10:36:11.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.633+0000 7f36b4fc0640 1 -- start start 2024-04-25T10:36:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36b4fc0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 0x7f36b01465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36b4fc0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36b00be4c0 0x7f36b0141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36b4fc0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b013e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36b4fc0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f36b0153f20 con 0x7f36b00be4c0 2024-04-25T10:36:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36b4fc0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f36b0153da0 con 0x7f36b006d2d0 2024-04-25T10:36:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36b4fc0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f36b01540a0 con 0x7f36b0143960 2024-04-25T10:36:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36b00be4c0 0x7f36b0141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36b00be4c0 0x7f36b0141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45400/0 (socket says 172.21.15.103:45400) 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 -- 172.21.15.103:0/180710378 learned_addr learned my addr 172.21.15.103:0/180710378 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36ae59c640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 0x7f36b01465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36aed9d640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b013e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 -- 172.21.15.103:0/180710378 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 msgr2=0x7f36b013e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b013e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 -- 172.21.15.103:0/180710378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 msgr2=0x7f36b01465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 0x7f36b01465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 -- 172.21.15.103:0/180710378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b009d2d0 con 0x7f36b00be4c0 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.634+0000 7f36add9b640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36b00be4c0 0x7f36b0141fa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c730 tx=0x7f36a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.635+0000 7f369effd640 1 -- 172.21.15.103:0/180710378 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4017070 con 0x7f36b00be4c0 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.635+0000 7f369effd640 1 -- 172.21.15.103:0/180710378 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a4005ad0 con 0x7f36b00be4c0 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.635+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b0146b20 con 0x7f36b00be4c0 2024-04-25T10:36:11.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.635+0000 7f369effd640 1 -- 172.21.15.103:0/180710378 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4007070 con 0x7f36b00be4c0 2024-04-25T10:36:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.635+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b01460c0 con 0x7f36b00be4c0 2024-04-25T10:36:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.636+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b006a130 con 0x7f36b00be4c0 2024-04-25T10:36:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.636+0000 7f369effd640 1 -- 172.21.15.103:0/180710378 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f36a401a070 con 0x7f36b00be4c0 2024-04-25T10:36:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.637+0000 7f369effd640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f36900744b0 0x7f36900769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.637+0000 7f36ae59c640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f36900744b0 0x7f36900769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.637+0000 7f369effd640 1 -- 172.21.15.103:0/180710378 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7f36a4094660 con 0x7f36b00be4c0 2024-04-25T10:36:11.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.637+0000 7f36ae59c640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f36900744b0 0x7f36900769c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009bd0 tx=0x7f36a000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:11.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.641+0000 7f369effd640 1 -- 172.21.15.103:0/180710378 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36b0146b20 con 0x7f36b00be4c0 2024-04-25T10:36:11.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.816+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 --> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36b00a0360 con 0x7f36900744b0 2024-04-25T10:36:11.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.822+0000 7f369effd640 1 -- 172.21.15.103:0/180710378 <== mgr.4107 v2:172.21.15.103:6832/1879218478 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252470 (secure 0 0 0) 0x7f36b00a0360 con 0x7f36900744b0 2024-04-25T10:36:11.827 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:36:11.829 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f36900744b0 msgr2=0x7f36900769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f36900744b0 0x7f36900769c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009bd0 tx=0x7f36a000b040 comp rx=0 tx=0).stop 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36b00be4c0 msgr2=0x7f36b0141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36b00be4c0 0x7f36b0141fa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f36a400c730 tx=0x7f36a400cbf0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 shutdown_connections 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f36900744b0 0x7f36900769c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f36b0143960 0x7f36b013e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36b00be4c0 0x7f36b0141fa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 --2- 172.21.15.103:0/180710378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36b006d2d0 0x7f36b01465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 >> 172.21.15.103:0/180710378 conn(0x7f36b00befa0 msgr2=0x7f36b00bcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 shutdown_connections 2024-04-25T10:36:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.825+0000 7f36b4fc0640 1 -- 172.21.15.103:0/180710378 wait complete. 2024-04-25T10:36:11.838 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2024-04-25T10:36:10.528363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":742067,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":69,"num_read_kb":58,"num_write":285,"num_write_kb":1868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1286,"ondisk_log_size":1286,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3547136,"data_stored":2197950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003117"},"pg_stats":[{"pgid":"3.3f","version":"23'15","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.732313+0000","last_change":"2024-04-25T10:35:31.732313+0000","last_active":"2024-04-25T10:35:31.732313+0000","last_peered":"2024-04-25T10:35:31.732313+0000","last_clean":"2024-04-25T10:35:31.732313+0000","last_became_active":"2024-04-25T10:33:43.180603+0000","last_became_peered":"2024-04-25T10:33:43.180603+0000","last_unstale":"2024-04-25T10:35:31.732313+0000","last_undegraded":"2024-04-25T10:35:31.732313+0000","last_fullsized":"2024-04-25T10:35:31.732313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:31.732176+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:31.732176+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.732176+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:30.190413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"23'10","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.403499+0000","last_change":"2024-04-25T10:35:35.403499+0000","last_active":"2024-04-25T10:35:35.403499+0000","last_peered":"2024-04-25T10:35:35.403499+0000","last_clean":"2024-04-25T10:35:35.403499+0000","last_became_active":"2024-04-25T10:33:43.170140+0000","last_became_peered":"2024-04-25T10:33:43.170140+0000","last_unstale":"2024-04-25T10:35:35.403499+0000","last_undegraded":"2024-04-25T10:35:35.403499+0000","last_fullsized":"2024-04-25T10:35:35.403499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:35.403294+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:35.403294+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.403294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:58.122725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"23'15","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.505663+0000","last_change":"2024-04-25T10:35:37.505663+0000","last_active":"2024-04-25T10:35:37.505663+0000","last_peered":"2024-04-25T10:35:37.505663+0000","last_clean":"2024-04-25T10:35:37.505663+0000","last_became_active":"2024-04-25T10:33:43.180966+0000","last_became_peered":"2024-04-25T10:33:43.180966+0000","last_unstale":"2024-04-25T10:35:37.505663+0000","last_undegraded":"2024-04-25T10:35:37.505663+0000","last_fullsized":"2024-04-25T10:35:37.505663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:37.505514+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:37.505514+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.505514+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:35.963752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"23'12","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.383347+0000","last_change":"2024-04-25T10:35:39.383347+0000","last_active":"2024-04-25T10:35:39.383347+0000","last_peered":"2024-04-25T10:35:39.383347+0000","last_clean":"2024-04-25T10:35:39.383347+0000","last_became_active":"2024-04-25T10:33:43.175771+0000","last_became_peered":"2024-04-25T10:33:43.175771+0000","last_unstale":"2024-04-25T10:35:39.383347+0000","last_undegraded":"2024-04-25T10:35:39.383347+0000","last_fullsized":"2024-04-25T10:35:39.383347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-04-25T10:35:39.383138+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-04-25T10:35:39.383138+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.383138+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:18:47.925469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"23'15","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:40.835850+0000","last_change":"2024-04-25T10:35:40.835882+0000","last_active":"2024-04-25T10:35:40.835850+0000","last_peered":"2024-04-25T10:35:40.835850+0000","last_clean":"2024-04-25T10:35:40.835850+0000","last_became_active":"2024-04-25T10:33:43.180909+0000","last_became_peered":"2024-04-25T10:33:43.180909+0000","last_unstale":"2024-04-25T10:35:40.835850+0000","last_undegraded":"2024-04-25T10:35:40.835850+0000","last_fullsized":"2024-04-25T10:35:40.835850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:40.835730+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:40.835730+0000","last_clean_scrub_stamp":"2024-04-25T10:35:40.835730+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:05.164260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.397934+0000","last_change":"2024-04-25T10:35:38.397964+0000","last_active":"2024-04-25T10:35:38.397934+0000","last_peered":"2024-04-25T10:35:38.397934+0000","last_clean":"2024-04-25T10:35:38.397934+0000","last_became_active":"2024-04-25T10:33:43.173859+0000","last_became_peered":"2024-04-25T10:33:43.173859+0000","last_unstale":"2024-04-25T10:35:38.397934+0000","last_undegraded":"2024-04-25T10:35:38.397934+0000","last_fullsized":"2024-04-25T10:35:38.397934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:38.397823+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:38.397823+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.397823+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:44.817456+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"23'11","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:45.871679+0000","last_change":"2024-04-25T10:35:45.871710+0000","last_active":"2024-04-25T10:35:45.871679+0000","last_peered":"2024-04-25T10:35:45.871679+0000","last_clean":"2024-04-25T10:35:45.871679+0000","last_became_active":"2024-04-25T10:33:43.185918+0000","last_became_peered":"2024-04-25T10:33:43.185918+0000","last_unstale":"2024-04-25T10:35:45.871679+0000","last_undegraded":"2024-04-25T10:35:45.871679+0000","last_fullsized":"2024-04-25T10:35:45.871679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-04-25T10:35:45.871566+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-04-25T10:35:45.871566+0000","last_clean_scrub_stamp":"2024-04-25T10:35:45.871566+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:32.221606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"23'10","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.828815+0000","last_change":"2024-04-25T10:35:38.828871+0000","last_active":"2024-04-25T10:35:38.828815+0000","last_peered":"2024-04-25T10:35:38.828815+0000","last_clean":"2024-04-25T10:35:38.828815+0000","last_became_active":"2024-04-25T10:33:43.169592+0000","last_became_peered":"2024-04-25T10:33:43.169592+0000","last_unstale":"2024-04-25T10:35:38.828815+0000","last_undegraded":"2024-04-25T10:35:38.828815+0000","last_fullsized":"2024-04-25T10:35:38.828815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:38.828668+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:38.828668+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.828668+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:01.130100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"23'18","reported_seq":50,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:47.884876+0000","last_change":"2024-04-25T10:35:47.884913+0000","last_active":"2024-04-25T10:35:47.884876+0000","last_peered":"2024-04-25T10:35:47.884876+0000","last_clean":"2024-04-25T10:35:47.884876+0000","last_became_active":"2024-04-25T10:34:24.320939+0000","last_became_peered":"2024-04-25T10:34:24.320939+0000","last_unstale":"2024-04-25T10:35:47.884876+0000","last_undegraded":"2024-04-25T10:35:47.884876+0000","last_fullsized":"2024-04-25T10:35:47.884876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:47.884756+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:47.884756+0000","last_clean_scrub_stamp":"2024-04-25T10:35:47.884756+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:02.612710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"23'26","reported_seq":53,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.453251+0000","last_change":"2024-04-25T10:35:38.453281+0000","last_active":"2024-04-25T10:35:38.453251+0000","last_peered":"2024-04-25T10:35:38.453251+0000","last_clean":"2024-04-25T10:35:38.453251+0000","last_became_active":"2024-04-25T10:33:43.175061+0000","last_became_peered":"2024-04-25T10:33:43.175061+0000","last_unstale":"2024-04-25T10:35:38.453251+0000","last_undegraded":"2024-04-25T10:35:38.453251+0000","last_fullsized":"2024-04-25T10:35:38.453251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'26","last_scrub_stamp":"2024-04-25T10:35:38.453152+0000","last_deep_scrub":"23'26","last_deep_scrub_stamp":"2024-04-25T10:35:38.453152+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.453152+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:18.939304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.517865+0000","last_change":"2024-04-25T10:35:36.517896+0000","last_active":"2024-04-25T10:35:36.517865+0000","last_peered":"2024-04-25T10:35:36.517865+0000","last_clean":"2024-04-25T10:35:36.517865+0000","last_became_active":"2024-04-25T10:33:43.174032+0000","last_became_peered":"2024-04-25T10:33:43.174032+0000","last_unstale":"2024-04-25T10:35:36.517865+0000","last_undegraded":"2024-04-25T10:35:36.517865+0000","last_fullsized":"2024-04-25T10:35:36.517865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:36.517749+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:36.517749+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.517749+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:00.695182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"23'12","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.654449+0000","last_change":"2024-04-25T10:35:33.654486+0000","last_active":"2024-04-25T10:35:33.654449+0000","last_peered":"2024-04-25T10:35:33.654449+0000","last_clean":"2024-04-25T10:35:33.654449+0000","last_became_active":"2024-04-25T10:33:43.176204+0000","last_became_peered":"2024-04-25T10:33:43.176204+0000","last_unstale":"2024-04-25T10:35:33.654449+0000","last_undegraded":"2024-04-25T10:35:33.654449+0000","last_fullsized":"2024-04-25T10:35:33.654449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-04-25T10:35:33.654306+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-04-25T10:35:33.654306+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.654306+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:13.407045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:40.844782+0000","last_change":"2024-04-25T10:35:40.844840+0000","last_active":"2024-04-25T10:35:40.844782+0000","last_peered":"2024-04-25T10:35:40.844782+0000","last_clean":"2024-04-25T10:35:40.844782+0000","last_became_active":"2024-04-25T10:33:43.176791+0000","last_became_peered":"2024-04-25T10:33:43.176791+0000","last_unstale":"2024-04-25T10:35:40.844782+0000","last_undegraded":"2024-04-25T10:35:40.844782+0000","last_fullsized":"2024-04-25T10:35:40.844782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:40.844663+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:40.844663+0000","last_clean_scrub_stamp":"2024-04-25T10:35:40.844663+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:18.180028+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'20","reported_seq":48,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.520908+0000","last_change":"2024-04-25T10:35:36.520908+0000","last_active":"2024-04-25T10:35:36.520908+0000","last_peered":"2024-04-25T10:35:36.520908+0000","last_clean":"2024-04-25T10:35:36.520908+0000","last_became_active":"2024-04-25T10:33:43.173136+0000","last_became_peered":"2024-04-25T10:33:43.173136+0000","last_unstale":"2024-04-25T10:35:36.520908+0000","last_undegraded":"2024-04-25T10:35:36.520908+0000","last_fullsized":"2024-04-25T10:35:36.520908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'20","last_scrub_stamp":"2024-04-25T10:35:36.520776+0000","last_deep_scrub":"23'20","last_deep_scrub_stamp":"2024-04-25T10:35:36.520776+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.520776+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:00.698209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"23'17","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.456230+0000","last_change":"2024-04-25T10:35:37.456230+0000","last_active":"2024-04-25T10:35:37.456230+0000","last_peered":"2024-04-25T10:35:37.456230+0000","last_clean":"2024-04-25T10:35:37.456230+0000","last_became_active":"2024-04-25T10:33:43.172261+0000","last_became_peered":"2024-04-25T10:33:43.172261+0000","last_unstale":"2024-04-25T10:35:37.456230+0000","last_undegraded":"2024-04-25T10:35:37.456230+0000","last_fullsized":"2024-04-25T10:35:37.456230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:37.456096+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:37.456096+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.456096+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:35.914333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'21","reported_seq":49,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.309884+0000","last_change":"2024-04-25T10:35:36.309884+0000","last_active":"2024-04-25T10:35:36.309884+0000","last_peered":"2024-04-25T10:35:36.309884+0000","last_clean":"2024-04-25T10:35:36.309884+0000","last_became_active":"2024-04-25T10:33:43.174014+0000","last_became_peered":"2024-04-25T10:33:43.174014+0000","last_unstale":"2024-04-25T10:35:36.309884+0000","last_undegraded":"2024-04-25T10:35:36.309884+0000","last_fullsized":"2024-04-25T10:35:36.309884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'21","last_scrub_stamp":"2024-04-25T10:35:36.309690+0000","last_deep_scrub":"23'21","last_deep_scrub_stamp":"2024-04-25T10:35:36.309690+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.309690+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:58.611122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"23'16","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:44.461458+0000","last_change":"2024-04-25T10:35:44.461458+0000","last_active":"2024-04-25T10:35:44.461458+0000","last_peered":"2024-04-25T10:35:44.461458+0000","last_clean":"2024-04-25T10:35:44.461458+0000","last_became_active":"2024-04-25T10:33:43.181782+0000","last_became_peered":"2024-04-25T10:33:43.181782+0000","last_unstale":"2024-04-25T10:35:44.461458+0000","last_undegraded":"2024-04-25T10:35:44.461458+0000","last_fullsized":"2024-04-25T10:35:44.461458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:44.461294+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:44.461294+0000","last_clean_scrub_stamp":"2024-04-25T10:35:44.461294+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:46.559223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"23'26","reported_seq":54,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.587445+0000","last_change":"2024-04-25T10:35:33.587445+0000","last_active":"2024-04-25T10:35:33.587445+0000","last_peered":"2024-04-25T10:35:33.587445+0000","last_clean":"2024-04-25T10:35:33.587445+0000","last_became_active":"2024-04-25T10:33:43.178701+0000","last_became_peered":"2024-04-25T10:33:43.178701+0000","last_unstale":"2024-04-25T10:35:33.587445+0000","last_undegraded":"2024-04-25T10:35:33.587445+0000","last_fullsized":"2024-04-25T10:35:33.587445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'26","last_scrub_stamp":"2024-04-25T10:35:33.587316+0000","last_deep_scrub":"23'26","last_deep_scrub_stamp":"2024-04-25T10:35:33.587316+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.587316+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:41.932915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"23'15","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:46.880477+0000","last_change":"2024-04-25T10:35:46.880477+0000","last_active":"2024-04-25T10:35:46.880477+0000","last_peered":"2024-04-25T10:35:46.880477+0000","last_clean":"2024-04-25T10:35:46.880477+0000","last_became_active":"2024-04-25T10:33:43.185044+0000","last_became_peered":"2024-04-25T10:33:43.185044+0000","last_unstale":"2024-04-25T10:35:46.880477+0000","last_undegraded":"2024-04-25T10:35:46.880477+0000","last_fullsized":"2024-04-25T10:35:46.880477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:46.880324+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:46.880324+0000","last_clean_scrub_stamp":"2024-04-25T10:35:46.880324+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:49.451158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"23'18","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.502289+0000","last_change":"2024-04-25T10:35:37.502289+0000","last_active":"2024-04-25T10:35:37.502289+0000","last_peered":"2024-04-25T10:35:37.502289+0000","last_clean":"2024-04-25T10:35:37.502289+0000","last_became_active":"2024-04-25T10:33:43.174732+0000","last_became_peered":"2024-04-25T10:33:43.174732+0000","last_unstale":"2024-04-25T10:35:37.502289+0000","last_undegraded":"2024-04-25T10:35:37.502289+0000","last_fullsized":"2024-04-25T10:35:37.502289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:37.502157+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:37.502157+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.502157+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:41.151165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"23'20","reported_seq":48,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.495277+0000","last_change":"2024-04-25T10:35:39.495277+0000","last_active":"2024-04-25T10:35:39.495277+0000","last_peered":"2024-04-25T10:35:39.495277+0000","last_clean":"2024-04-25T10:35:39.495277+0000","last_became_active":"2024-04-25T10:33:43.182750+0000","last_became_peered":"2024-04-25T10:33:43.182750+0000","last_unstale":"2024-04-25T10:35:39.495277+0000","last_undegraded":"2024-04-25T10:35:39.495277+0000","last_fullsized":"2024-04-25T10:35:39.495277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'20","last_scrub_stamp":"2024-04-25T10:35:39.495140+0000","last_deep_scrub":"23'20","last_deep_scrub_stamp":"2024-04-25T10:35:39.495140+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.495140+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:59.461951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"23'19","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:42.448047+0000","last_change":"2024-04-25T10:35:42.448047+0000","last_active":"2024-04-25T10:35:42.448047+0000","last_peered":"2024-04-25T10:35:42.448047+0000","last_clean":"2024-04-25T10:35:42.448047+0000","last_became_active":"2024-04-25T10:33:43.179797+0000","last_became_peered":"2024-04-25T10:33:43.179797+0000","last_unstale":"2024-04-25T10:35:42.448047+0000","last_undegraded":"2024-04-25T10:35:42.448047+0000","last_fullsized":"2024-04-25T10:35:42.448047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:42.447861+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:42.447861+0000","last_clean_scrub_stamp":"2024-04-25T10:35:42.447861+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:44.461800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"23'19","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.767671+0000","last_change":"2024-04-25T10:35:32.767671+0000","last_active":"2024-04-25T10:35:32.767671+0000","last_peered":"2024-04-25T10:35:32.767671+0000","last_clean":"2024-04-25T10:35:32.767671+0000","last_became_active":"2024-04-25T10:33:43.161899+0000","last_became_peered":"2024-04-25T10:33:43.161899+0000","last_unstale":"2024-04-25T10:35:32.767671+0000","last_undegraded":"2024-04-25T10:35:32.767671+0000","last_fullsized":"2024-04-25T10:35:32.767671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:32.767481+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:32.767481+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.767481+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:52.732585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"23'15","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:45.493640+0000","last_change":"2024-04-25T10:35:45.493640+0000","last_active":"2024-04-25T10:35:45.493640+0000","last_peered":"2024-04-25T10:35:45.493640+0000","last_clean":"2024-04-25T10:35:45.493640+0000","last_became_active":"2024-04-25T10:33:43.183420+0000","last_became_peered":"2024-04-25T10:33:43.183420+0000","last_unstale":"2024-04-25T10:35:45.493640+0000","last_undegraded":"2024-04-25T10:35:45.493640+0000","last_fullsized":"2024-04-25T10:35:45.493640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:45.493508+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:45.493508+0000","last_clean_scrub_stamp":"2024-04-25T10:35:45.493508+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:59.768500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"23'11","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.523756+0000","last_change":"2024-04-25T10:35:36.523786+0000","last_active":"2024-04-25T10:35:36.523756+0000","last_peered":"2024-04-25T10:35:36.523756+0000","last_clean":"2024-04-25T10:35:36.523756+0000","last_became_active":"2024-04-25T10:34:24.299359+0000","last_became_peered":"2024-04-25T10:34:24.299359+0000","last_unstale":"2024-04-25T10:35:36.523756+0000","last_undegraded":"2024-04-25T10:35:36.523756+0000","last_fullsized":"2024-04-25T10:35:36.523756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-04-25T10:35:36.523658+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-04-25T10:35:36.523658+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.523658+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:35.717047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"23'23","reported_seq":51,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:41.485471+0000","last_change":"2024-04-25T10:35:41.485471+0000","last_active":"2024-04-25T10:35:41.485471+0000","last_peered":"2024-04-25T10:35:41.485471+0000","last_clean":"2024-04-25T10:35:41.485471+0000","last_became_active":"2024-04-25T10:33:43.182597+0000","last_became_peered":"2024-04-25T10:33:43.182597+0000","last_unstale":"2024-04-25T10:35:41.485471+0000","last_undegraded":"2024-04-25T10:35:41.485471+0000","last_fullsized":"2024-04-25T10:35:41.485471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23","last_scrub_stamp":"2024-04-25T10:35:41.485300+0000","last_deep_scrub":"23'23","last_deep_scrub_stamp":"2024-04-25T10:35:41.485300+0000","last_clean_scrub_stamp":"2024-04-25T10:35:41.485300+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:39.067925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'16","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.524839+0000","last_change":"2024-04-25T10:35:39.524839+0000","last_active":"2024-04-25T10:35:39.524839+0000","last_peered":"2024-04-25T10:35:39.524839+0000","last_clean":"2024-04-25T10:35:39.524839+0000","last_became_active":"2024-04-25T10:33:43.174909+0000","last_became_peered":"2024-04-25T10:33:43.174909+0000","last_unstale":"2024-04-25T10:35:39.524839+0000","last_undegraded":"2024-04-25T10:35:39.524839+0000","last_fullsized":"2024-04-25T10:35:39.524839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:39.524711+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:39.524711+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.524711+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:59.491521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"23'10","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.803639+0000","last_change":"2024-04-25T10:35:33.803639+0000","last_active":"2024-04-25T10:35:33.803639+0000","last_peered":"2024-04-25T10:35:33.803639+0000","last_clean":"2024-04-25T10:35:33.803639+0000","last_became_active":"2024-04-25T10:33:43.162270+0000","last_became_peered":"2024-04-25T10:33:43.162270+0000","last_unstale":"2024-04-25T10:35:33.803639+0000","last_undegraded":"2024-04-25T10:35:33.803639+0000","last_fullsized":"2024-04-25T10:35:33.803639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:33.803449+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:33.803449+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.803449+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:57.722376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"23'14","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.530088+0000","last_change":"2024-04-25T10:35:31.530088+0000","last_active":"2024-04-25T10:35:31.530088+0000","last_peered":"2024-04-25T10:35:31.530088+0000","last_clean":"2024-04-25T10:35:31.530088+0000","last_became_active":"2024-04-25T10:33:43.168264+0000","last_became_peered":"2024-04-25T10:33:43.168264+0000","last_unstale":"2024-04-25T10:35:31.530088+0000","last_undegraded":"2024-04-25T10:35:31.530088+0000","last_fullsized":"2024-04-25T10:35:31.530088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:31.529955+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:31.529955+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.529955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:53.051421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"23'18","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:43.438379+0000","last_change":"2024-04-25T10:35:43.438379+0000","last_active":"2024-04-25T10:35:43.438379+0000","last_peered":"2024-04-25T10:35:43.438379+0000","last_clean":"2024-04-25T10:35:43.438379+0000","last_became_active":"2024-04-25T10:33:43.182641+0000","last_became_peered":"2024-04-25T10:33:43.182641+0000","last_unstale":"2024-04-25T10:35:43.438379+0000","last_undegraded":"2024-04-25T10:35:43.438379+0000","last_fullsized":"2024-04-25T10:35:43.438379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:43.438213+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:43.438213+0000","last_clean_scrub_stamp":"2024-04-25T10:35:43.438213+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:27.731847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"23'19","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.600913+0000","last_change":"2024-04-25T10:35:32.600913+0000","last_active":"2024-04-25T10:35:32.600913+0000","last_peered":"2024-04-25T10:35:32.600913+0000","last_clean":"2024-04-25T10:35:32.600913+0000","last_became_active":"2024-04-25T10:33:43.171146+0000","last_became_peered":"2024-04-25T10:33:43.171146+0000","last_unstale":"2024-04-25T10:35:32.600913+0000","last_undegraded":"2024-04-25T10:35:32.600913+0000","last_fullsized":"2024-04-25T10:35:32.600913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:32.600782+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:32.600782+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.600782+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:54.932750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"23'18","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:40.508714+0000","last_change":"2024-04-25T10:35:40.508714+0000","last_active":"2024-04-25T10:35:40.508714+0000","last_peered":"2024-04-25T10:35:40.508714+0000","last_clean":"2024-04-25T10:35:40.508714+0000","last_became_active":"2024-04-25T10:33:43.183076+0000","last_became_peered":"2024-04-25T10:33:43.183076+0000","last_unstale":"2024-04-25T10:35:40.508714+0000","last_undegraded":"2024-04-25T10:35:40.508714+0000","last_fullsized":"2024-04-25T10:35:40.508714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:40.508587+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:40.508587+0000","last_clean_scrub_stamp":"2024-04-25T10:35:40.508587+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:25.432389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.644365+0000","last_change":"2024-04-25T10:35:31.644392+0000","last_active":"2024-04-25T10:35:31.644365+0000","last_peered":"2024-04-25T10:35:31.644365+0000","last_clean":"2024-04-25T10:35:31.644365+0000","last_became_active":"2024-04-25T10:33:43.169775+0000","last_became_peered":"2024-04-25T10:33:43.169775+0000","last_unstale":"2024-04-25T10:35:31.644365+0000","last_undegraded":"2024-04-25T10:35:31.644365+0000","last_fullsized":"2024-04-25T10:35:31.644365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:31.644265+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:31.644265+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.644265+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:11.124923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.746883+0000","last_change":"2024-04-25T10:35:31.746931+0000","last_active":"2024-04-25T10:35:31.746883+0000","last_peered":"2024-04-25T10:35:31.746883+0000","last_clean":"2024-04-25T10:35:31.746883+0000","last_became_active":"2024-04-25T10:33:42.161815+0000","last_became_peered":"2024-04-25T10:33:42.161815+0000","last_unstale":"2024-04-25T10:35:31.746883+0000","last_undegraded":"2024-04-25T10:35:31.746883+0000","last_fullsized":"2024-04-25T10:35:31.746883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-25T10:35:31.746785+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-25T10:35:31.746785+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.746785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:26.011558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.577886+0000","last_change":"2024-04-25T10:35:32.577967+0000","last_active":"2024-04-25T10:35:32.577886+0000","last_peered":"2024-04-25T10:35:32.577886+0000","last_clean":"2024-04-25T10:35:32.577886+0000","last_became_active":"2024-04-25T10:33:43.171797+0000","last_became_peered":"2024-04-25T10:33:43.171797+0000","last_unstale":"2024-04-25T10:35:32.577886+0000","last_undegraded":"2024-04-25T10:35:32.577886+0000","last_fullsized":"2024-04-25T10:35:32.577886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:32.577754+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:32.577754+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.577754+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:31.368014+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.526764+0000","last_change":"2024-04-25T10:35:31.526812+0000","last_active":"2024-04-25T10:35:31.526764+0000","last_peered":"2024-04-25T10:35:31.526764+0000","last_clean":"2024-04-25T10:35:31.526764+0000","last_became_active":"2024-04-25T10:33:42.161143+0000","last_became_peered":"2024-04-25T10:33:42.161143+0000","last_unstale":"2024-04-25T10:35:31.526764+0000","last_undegraded":"2024-04-25T10:35:31.526764+0000","last_fullsized":"2024-04-25T10:35:31.526764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-25T10:35:31.526660+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-25T10:35:31.526660+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.526660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:33.671141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.746982+0000","last_change":"2024-04-25T10:35:29.747023+0000","last_active":"2024-04-25T10:35:29.746982+0000","last_peered":"2024-04-25T10:35:29.746982+0000","last_clean":"2024-04-25T10:35:29.746982+0000","last_became_active":"2024-04-25T10:33:42.158598+0000","last_became_peered":"2024-04-25T10:33:42.158598+0000","last_unstale":"2024-04-25T10:35:29.746982+0000","last_undegraded":"2024-04-25T10:35:29.746982+0000","last_fullsized":"2024-04-25T10:35:29.746982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:29.746859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:29.746859+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.746859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:31.891340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.876464+0000","last_change":"2024-04-25T10:35:37.876506+0000","last_active":"2024-04-25T10:35:37.876464+0000","last_peered":"2024-04-25T10:35:37.876464+0000","last_clean":"2024-04-25T10:35:37.876464+0000","last_became_active":"2024-04-25T10:33:43.169028+0000","last_became_peered":"2024-04-25T10:33:43.169028+0000","last_unstale":"2024-04-25T10:35:37.876464+0000","last_undegraded":"2024-04-25T10:35:37.876464+0000","last_fullsized":"2024-04-25T10:35:37.876464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:37.876354+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:37.876354+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.876354+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:11.188146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.299862+0000","last_change":"2024-04-25T10:35:31.299908+0000","last_active":"2024-04-25T10:35:31.299862+0000","last_peered":"2024-04-25T10:35:31.299862+0000","last_clean":"2024-04-25T10:35:31.299862+0000","last_became_active":"2024-04-25T10:33:42.161872+0000","last_became_peered":"2024-04-25T10:33:42.161872+0000","last_unstale":"2024-04-25T10:35:31.299862+0000","last_undegraded":"2024-04-25T10:35:31.299862+0000","last_fullsized":"2024-04-25T10:35:31.299862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:31.299712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:31.299712+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.299712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:55.218639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"23'18","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.504655+0000","last_change":"2024-04-25T10:35:38.504689+0000","last_active":"2024-04-25T10:35:38.504655+0000","last_peered":"2024-04-25T10:35:38.504655+0000","last_clean":"2024-04-25T10:35:38.504655+0000","last_became_active":"2024-04-25T10:33:43.174030+0000","last_became_peered":"2024-04-25T10:33:43.174030+0000","last_unstale":"2024-04-25T10:35:38.504655+0000","last_undegraded":"2024-04-25T10:35:38.504655+0000","last_fullsized":"2024-04-25T10:35:38.504655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:38.504541+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:38.504541+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.504541+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:35.328438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'1","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.502057+0000","last_change":"2024-04-25T10:35:32.502132+0000","last_active":"2024-04-25T10:35:32.502057+0000","last_peered":"2024-04-25T10:35:32.502057+0000","last_clean":"2024-04-25T10:35:32.502057+0000","last_became_active":"2024-04-25T10:33:42.162859+0000","last_became_peered":"2024-04-25T10:33:42.162859+0000","last_unstale":"2024-04-25T10:35:32.502057+0000","last_undegraded":"2024-04-25T10:35:32.502057+0000","last_fullsized":"2024-04-25T10:35:32.502057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-25T10:35:32.501920+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-25T10:35:32.501920+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.501920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:26.305045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:40.391805+0000","last_change":"2024-04-25T10:35:40.391861+0000","last_active":"2024-04-25T10:35:40.391805+0000","last_peered":"2024-04-25T10:35:40.391805+0000","last_clean":"2024-04-25T10:35:40.391805+0000","last_became_active":"2024-04-25T10:33:43.177336+0000","last_became_peered":"2024-04-25T10:33:43.177336+0000","last_unstale":"2024-04-25T10:35:40.391805+0000","last_undegraded":"2024-04-25T10:35:40.391805+0000","last_fullsized":"2024-04-25T10:35:40.391805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:40.391659+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:40.391659+0000","last_clean_scrub_stamp":"2024-04-25T10:35:40.391659+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:42.203453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.303723+0000","last_change":"2024-04-25T10:35:34.303781+0000","last_active":"2024-04-25T10:35:34.303723+0000","last_peered":"2024-04-25T10:35:34.303723+0000","last_clean":"2024-04-25T10:35:34.303723+0000","last_became_active":"2024-04-25T10:33:42.168222+0000","last_became_peered":"2024-04-25T10:33:42.168222+0000","last_unstale":"2024-04-25T10:35:34.303723+0000","last_undegraded":"2024-04-25T10:35:34.303723+0000","last_fullsized":"2024-04-25T10:35:34.303723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:34.303599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:34.303599+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.303599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:31.127496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'17","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.611721+0000","last_change":"2024-04-25T10:35:33.611815+0000","last_active":"2024-04-25T10:35:33.611721+0000","last_peered":"2024-04-25T10:35:33.611721+0000","last_clean":"2024-04-25T10:35:33.611721+0000","last_became_active":"2024-04-25T10:33:43.171814+0000","last_became_peered":"2024-04-25T10:33:43.171814+0000","last_unstale":"2024-04-25T10:35:33.611721+0000","last_undegraded":"2024-04-25T10:35:33.611721+0000","last_fullsized":"2024-04-25T10:35:33.611721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:33.611599+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:33.611599+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.611599+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:52.031610+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"23'7","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.521930+0000","last_change":"2024-04-25T10:35:31.521997+0000","last_active":"2024-04-25T10:35:31.521930+0000","last_peered":"2024-04-25T10:35:31.521930+0000","last_clean":"2024-04-25T10:35:31.521930+0000","last_became_active":"2024-04-25T10:33:42.160339+0000","last_became_peered":"2024-04-25T10:33:42.160339+0000","last_unstale":"2024-04-25T10:35:31.521930+0000","last_undegraded":"2024-04-25T10:35:31.521930+0000","last_fullsized":"2024-04-25T10:35:31.521930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-04-25T10:35:31.521813+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-04-25T10:35:31.521813+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.521813+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:53.043279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'19","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.627895+0000","last_change":"2024-04-25T10:35:34.627895+0000","last_active":"2024-04-25T10:35:34.627895+0000","last_peered":"2024-04-25T10:35:34.627895+0000","last_clean":"2024-04-25T10:35:34.627895+0000","last_became_active":"2024-04-25T10:33:43.178125+0000","last_became_peered":"2024-04-25T10:33:43.178125+0000","last_unstale":"2024-04-25T10:35:34.627895+0000","last_undegraded":"2024-04-25T10:35:34.627895+0000","last_fullsized":"2024-04-25T10:35:34.627895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:34.627760+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:34.627760+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.627760+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:00.772977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"23'118","reported_seq":148,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.482250+0000","last_change":"2024-04-25T10:35:30.482250+0000","last_active":"2024-04-25T10:35:30.482250+0000","last_peered":"2024-04-25T10:35:30.482250+0000","last_clean":"2024-04-25T10:35:30.482250+0000","last_became_active":"2024-04-25T10:33:42.159920+0000","last_became_peered":"2024-04-25T10:33:42.159920+0000","last_unstale":"2024-04-25T10:35:30.482250+0000","last_undegraded":"2024-04-25T10:35:30.482250+0000","last_fullsized":"2024-04-25T10:35:30.482250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'118","last_scrub_stamp":"2024-04-25T10:35:30.482114+0000","last_deep_scrub":"23'118","last_deep_scrub_stamp":"2024-04-25T10:35:30.482114+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.482114+0000","objects_scrubbed":4,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:32.604791+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149769,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"23'14","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.846297+0000","last_change":"2024-04-25T10:35:39.846357+0000","last_active":"2024-04-25T10:35:39.846297+0000","last_peered":"2024-04-25T10:35:39.846297+0000","last_clean":"2024-04-25T10:35:39.846297+0000","last_became_active":"2024-04-25T10:33:43.180280+0000","last_became_peered":"2024-04-25T10:33:43.180280+0000","last_unstale":"2024-04-25T10:35:39.846297+0000","last_undegraded":"2024-04-25T10:35:39.846297+0000","last_fullsized":"2024-04-25T10:35:39.846297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:39.846180+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:39.846180+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.846180+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:09.909957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"23'5","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:28.509479+0000","last_change":"2024-04-25T10:35:28.509479+0000","last_active":"2024-04-25T10:35:28.509479+0000","last_peered":"2024-04-25T10:35:28.509479+0000","last_clean":"2024-04-25T10:35:28.509479+0000","last_became_active":"2024-04-25T10:33:42.163748+0000","last_became_peered":"2024-04-25T10:33:42.163748+0000","last_unstale":"2024-04-25T10:35:28.509479+0000","last_undegraded":"2024-04-25T10:35:28.509479+0000","last_fullsized":"2024-04-25T10:35:28.509479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'5","last_scrub_stamp":"2024-04-25T10:35:28.509276+0000","last_deep_scrub":"23'5","last_deep_scrub_stamp":"2024-04-25T10:35:28.509276+0000","last_clean_scrub_stamp":"2024-04-25T10:35:28.509276+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:08.262016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'19","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.457628+0000","last_change":"2024-04-25T10:35:38.457628+0000","last_active":"2024-04-25T10:35:38.457628+0000","last_peered":"2024-04-25T10:35:38.457628+0000","last_clean":"2024-04-25T10:35:38.457628+0000","last_became_active":"2024-04-25T10:33:43.181173+0000","last_became_peered":"2024-04-25T10:33:43.181173+0000","last_unstale":"2024-04-25T10:35:38.457628+0000","last_undegraded":"2024-04-25T10:35:38.457628+0000","last_fullsized":"2024-04-25T10:35:38.457628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:38.457433+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:38.457433+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.457433+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:35.281330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.280694+0000","last_change":"2024-04-25T10:35:32.280694+0000","last_active":"2024-04-25T10:35:32.280694+0000","last_peered":"2024-04-25T10:35:32.280694+0000","last_clean":"2024-04-25T10:35:32.280694+0000","last_became_active":"2024-04-25T10:33:42.162828+0000","last_became_peered":"2024-04-25T10:33:42.162828+0000","last_unstale":"2024-04-25T10:35:32.280694+0000","last_undegraded":"2024-04-25T10:35:32.280694+0000","last_fullsized":"2024-04-25T10:35:32.280694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:32.280528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:32.280528+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.280528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:30.220799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'27","reported_seq":55,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:42.877058+0000","last_change":"2024-04-25T10:35:42.877058+0000","last_active":"2024-04-25T10:35:42.877058+0000","last_peered":"2024-04-25T10:35:42.877058+0000","last_clean":"2024-04-25T10:35:42.877058+0000","last_became_active":"2024-04-25T10:33:43.183018+0000","last_became_peered":"2024-04-25T10:33:43.183018+0000","last_unstale":"2024-04-25T10:35:42.877058+0000","last_undegraded":"2024-04-25T10:35:42.877058+0000","last_fullsized":"2024-04-25T10:35:42.877058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'27","last_scrub_stamp":"2024-04-25T10:35:42.876913+0000","last_deep_scrub":"23'27","last_deep_scrub_stamp":"2024-04-25T10:35:42.876913+0000","last_clean_scrub_stamp":"2024-04-25T10:35:42.876913+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:47.034570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.509026+0000","last_change":"2024-04-25T10:35:34.509026+0000","last_active":"2024-04-25T10:35:34.509026+0000","last_peered":"2024-04-25T10:35:34.509026+0000","last_clean":"2024-04-25T10:35:34.509026+0000","last_became_active":"2024-04-25T10:33:42.163972+0000","last_became_peered":"2024-04-25T10:33:42.163972+0000","last_unstale":"2024-04-25T10:35:34.509026+0000","last_undegraded":"2024-04-25T10:35:34.509026+0000","last_fullsized":"2024-04-25T10:35:34.509026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:34.508877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:34.508877+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.508877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:33.702266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"23'15","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.467731+0000","last_change":"2024-04-25T10:35:39.467731+0000","last_active":"2024-04-25T10:35:39.467731+0000","last_peered":"2024-04-25T10:35:39.467731+0000","last_clean":"2024-04-25T10:35:39.467731+0000","last_became_active":"2024-04-25T10:33:43.175816+0000","last_became_peered":"2024-04-25T10:33:43.175816+0000","last_unstale":"2024-04-25T10:35:39.467731+0000","last_undegraded":"2024-04-25T10:35:39.467731+0000","last_fullsized":"2024-04-25T10:35:39.467731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:39.467586+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:39.467586+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.467586+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:12.779378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"23'12","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:28.688829+0000","last_change":"2024-04-25T10:35:28.688829+0000","last_active":"2024-04-25T10:35:28.688829+0000","last_peered":"2024-04-25T10:35:28.688829+0000","last_clean":"2024-04-25T10:35:28.688829+0000","last_became_active":"2024-04-25T10:33:42.155829+0000","last_became_peered":"2024-04-25T10:33:42.155829+0000","last_unstale":"2024-04-25T10:35:28.688829+0000","last_undegraded":"2024-04-25T10:35:28.688829+0000","last_fullsized":"2024-04-25T10:35:28.688829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-04-25T10:35:28.688706+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-04-25T10:35:28.688706+0000","last_clean_scrub_stamp":"2024-04-25T10:35:28.688706+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:08.169364+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"23'14","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:41.881633+0000","last_change":"2024-04-25T10:35:41.881633+0000","last_active":"2024-04-25T10:35:41.881633+0000","last_peered":"2024-04-25T10:35:41.881633+0000","last_clean":"2024-04-25T10:35:41.881633+0000","last_became_active":"2024-04-25T10:33:43.182790+0000","last_became_peered":"2024-04-25T10:33:43.182790+0000","last_unstale":"2024-04-25T10:35:41.881633+0000","last_undegraded":"2024-04-25T10:35:41.881633+0000","last_fullsized":"2024-04-25T10:35:41.881633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:41.881498+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:41.881498+0000","last_clean_scrub_stamp":"2024-04-25T10:35:41.881498+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:41.676941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'2","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.574075+0000","last_change":"2024-04-25T10:35:29.574075+0000","last_active":"2024-04-25T10:35:29.574075+0000","last_peered":"2024-04-25T10:35:29.574075+0000","last_clean":"2024-04-25T10:35:29.574075+0000","last_became_active":"2024-04-25T10:33:42.162085+0000","last_became_peered":"2024-04-25T10:33:42.162085+0000","last_unstale":"2024-04-25T10:35:29.574075+0000","last_undegraded":"2024-04-25T10:35:29.574075+0000","last_fullsized":"2024-04-25T10:35:29.574075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-04-25T10:35:29.573923+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-04-25T10:35:29.573923+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.573923+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:03.854727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'12","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.592509+0000","last_change":"2024-04-25T10:35:34.592569+0000","last_active":"2024-04-25T10:35:34.592509+0000","last_peered":"2024-04-25T10:35:34.592509+0000","last_clean":"2024-04-25T10:35:34.592509+0000","last_became_active":"2024-04-25T10:34:24.298059+0000","last_became_peered":"2024-04-25T10:34:24.298059+0000","last_unstale":"2024-04-25T10:35:34.592509+0000","last_undegraded":"2024-04-25T10:35:34.592509+0000","last_fullsized":"2024-04-25T10:35:34.592509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'12","last_scrub_stamp":"2024-04-25T10:35:34.592355+0000","last_deep_scrub":"23'12","last_deep_scrub_stamp":"2024-04-25T10:35:34.592355+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.592355+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:56.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"23'3","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.683269+0000","last_change":"2024-04-25T10:35:29.683269+0000","last_active":"2024-04-25T10:35:29.683269+0000","last_peered":"2024-04-25T10:35:29.683269+0000","last_clean":"2024-04-25T10:35:29.683269+0000","last_became_active":"2024-04-25T10:33:42.159172+0000","last_became_peered":"2024-04-25T10:33:42.159172+0000","last_unstale":"2024-04-25T10:35:29.683269+0000","last_undegraded":"2024-04-25T10:35:29.683269+0000","last_fullsized":"2024-04-25T10:35:29.683269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-04-25T10:35:29.683135+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-04-25T10:35:29.683135+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.683135+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:18.672756+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'17","reported_seq":45,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:44.821749+0000","last_change":"2024-04-25T10:35:44.821749+0000","last_active":"2024-04-25T10:35:44.821749+0000","last_peered":"2024-04-25T10:35:44.821749+0000","last_clean":"2024-04-25T10:35:44.821749+0000","last_became_active":"2024-04-25T10:33:43.181535+0000","last_became_peered":"2024-04-25T10:33:43.181535+0000","last_unstale":"2024-04-25T10:35:44.821749+0000","last_undegraded":"2024-04-25T10:35:44.821749+0000","last_fullsized":"2024-04-25T10:35:44.821749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'17","last_scrub_stamp":"2024-04-25T10:35:44.821550+0000","last_deep_scrub":"23'17","last_deep_scrub_stamp":"2024-04-25T10:35:44.821550+0000","last_clean_scrub_stamp":"2024-04-25T10:35:44.821550+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:22:32.713374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'2","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:28.511683+0000","last_change":"2024-04-25T10:35:28.511683+0000","last_active":"2024-04-25T10:35:28.511683+0000","last_peered":"2024-04-25T10:35:28.511683+0000","last_clean":"2024-04-25T10:35:28.511683+0000","last_became_active":"2024-04-25T10:33:42.151692+0000","last_became_peered":"2024-04-25T10:33:42.151692+0000","last_unstale":"2024-04-25T10:35:28.511683+0000","last_undegraded":"2024-04-25T10:35:28.511683+0000","last_fullsized":"2024-04-25T10:35:28.511683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2024-04-25T10:35:28.511559+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2024-04-25T10:35:28.511559+0000","last_clean_scrub_stamp":"2024-04-25T10:35:28.511559+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:08.264299+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"23'18","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.549175+0000","last_change":"2024-04-25T10:35:35.549208+0000","last_active":"2024-04-25T10:35:35.549175+0000","last_peered":"2024-04-25T10:35:35.549175+0000","last_clean":"2024-04-25T10:35:35.549175+0000","last_became_active":"2024-04-25T10:34:24.299411+0000","last_became_peered":"2024-04-25T10:34:24.299411+0000","last_unstale":"2024-04-25T10:35:35.549175+0000","last_undegraded":"2024-04-25T10:35:35.549175+0000","last_fullsized":"2024-04-25T10:35:35.549175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:35.549069+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:35.549069+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.549069+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:34.339329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:31.640288+0000","last_change":"2024-04-25T10:35:31.640288+0000","last_active":"2024-04-25T10:35:31.640288+0000","last_peered":"2024-04-25T10:35:31.640288+0000","last_clean":"2024-04-25T10:35:31.640288+0000","last_became_active":"2024-04-25T10:33:42.166822+0000","last_became_peered":"2024-04-25T10:33:42.166822+0000","last_unstale":"2024-04-25T10:35:31.640288+0000","last_undegraded":"2024-04-25T10:35:31.640288+0000","last_fullsized":"2024-04-25T10:35:31.640288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:31.640154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:31.640154+0000","last_clean_scrub_stamp":"2024-04-25T10:35:31.640154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:54.212979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'15","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:43.860617+0000","last_change":"2024-04-25T10:35:43.860617+0000","last_active":"2024-04-25T10:35:43.860617+0000","last_peered":"2024-04-25T10:35:43.860617+0000","last_clean":"2024-04-25T10:35:43.860617+0000","last_became_active":"2024-04-25T10:33:43.184338+0000","last_became_peered":"2024-04-25T10:33:43.184338+0000","last_unstale":"2024-04-25T10:35:43.860617+0000","last_undegraded":"2024-04-25T10:35:43.860617+0000","last_fullsized":"2024-04-25T10:35:43.860617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:43.860478+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:43.860478+0000","last_clean_scrub_stamp":"2024-04-25T10:35:43.860478+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:50.873543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'74","reported_seq":128,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.722189+0000","last_change":"2024-04-25T10:35:32.722189+0000","last_active":"2024-04-25T10:35:32.722189+0000","last_peered":"2024-04-25T10:35:32.722189+0000","last_clean":"2024-04-25T10:35:32.722189+0000","last_became_active":"2024-04-25T10:33:31.707893+0000","last_became_peered":"2024-04-25T10:33:31.707893+0000","last_unstale":"2024-04-25T10:35:32.722189+0000","last_undegraded":"2024-04-25T10:35:32.722189+0000","last_fullsized":"2024-04-25T10:35:32.722189+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'74","last_scrub_stamp":"2024-04-25T10:35:32.722036+0000","last_deep_scrub":"23'74","last_deep_scrub_stamp":"2024-04-25T10:35:32.722036+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.722036+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:21:29.545933+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.312496+0000","last_change":"2024-04-25T10:35:33.312496+0000","last_active":"2024-04-25T10:35:33.312496+0000","last_peered":"2024-04-25T10:35:33.312496+0000","last_clean":"2024-04-25T10:35:33.312496+0000","last_became_active":"2024-04-25T10:33:42.163976+0000","last_became_peered":"2024-04-25T10:33:42.163976+0000","last_unstale":"2024-04-25T10:35:33.312496+0000","last_undegraded":"2024-04-25T10:35:33.312496+0000","last_fullsized":"2024-04-25T10:35:33.312496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:33.312288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:33.312288+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.312288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:36.961296+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"23'10","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.844735+0000","last_change":"2024-04-25T10:35:36.844735+0000","last_active":"2024-04-25T10:35:36.844735+0000","last_peered":"2024-04-25T10:35:36.844735+0000","last_clean":"2024-04-25T10:35:36.844735+0000","last_became_active":"2024-04-25T10:33:43.169681+0000","last_became_peered":"2024-04-25T10:33:43.169681+0000","last_unstale":"2024-04-25T10:35:36.844735+0000","last_undegraded":"2024-04-25T10:35:36.844735+0000","last_fullsized":"2024-04-25T10:35:36.844735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:36.844540+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:36.844540+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.844540+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:59:17.330692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.738221+0000","last_change":"2024-04-25T10:35:33.738221+0000","last_active":"2024-04-25T10:35:33.738221+0000","last_peered":"2024-04-25T10:35:33.738221+0000","last_clean":"2024-04-25T10:35:33.738221+0000","last_became_active":"2024-04-25T10:33:42.163482+0000","last_became_peered":"2024-04-25T10:33:42.163482+0000","last_unstale":"2024-04-25T10:35:33.738221+0000","last_undegraded":"2024-04-25T10:35:33.738221+0000","last_fullsized":"2024-04-25T10:35:33.738221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:33.738035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:33.738035+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.738035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:53.704846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'10","reported_seq":38,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.481883+0000","last_change":"2024-04-25T10:35:30.481883+0000","last_active":"2024-04-25T10:35:30.481883+0000","last_peered":"2024-04-25T10:35:30.481883+0000","last_clean":"2024-04-25T10:35:30.481883+0000","last_became_active":"2024-04-25T10:33:43.164753+0000","last_became_peered":"2024-04-25T10:33:43.164753+0000","last_unstale":"2024-04-25T10:35:30.481883+0000","last_undegraded":"2024-04-25T10:35:30.481883+0000","last_fullsized":"2024-04-25T10:35:30.481883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'10","last_scrub_stamp":"2024-04-25T10:35:30.481718+0000","last_deep_scrub":"23'10","last_deep_scrub_stamp":"2024-04-25T10:35:30.481718+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.481718+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:38.827316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"23'4","reported_seq":37,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.644177+0000","last_change":"2024-04-25T10:35:30.644177+0000","last_active":"2024-04-25T10:35:30.644177+0000","last_peered":"2024-04-25T10:35:30.644177+0000","last_clean":"2024-04-25T10:35:30.644177+0000","last_became_active":"2024-04-25T10:33:42.159700+0000","last_became_peered":"2024-04-25T10:33:42.159700+0000","last_unstale":"2024-04-25T10:35:30.644177+0000","last_undegraded":"2024-04-25T10:35:30.644177+0000","last_fullsized":"2024-04-25T10:35:30.644177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-04-25T10:35:30.643989+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-04-25T10:35:30.643989+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.643989+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:23.642545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1111,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"23'21","reported_seq":49,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.422129+0000","last_change":"2024-04-25T10:35:36.422129+0000","last_active":"2024-04-25T10:35:36.422129+0000","last_peered":"2024-04-25T10:35:36.422129+0000","last_clean":"2024-04-25T10:35:36.422129+0000","last_became_active":"2024-04-25T10:33:43.170157+0000","last_became_peered":"2024-04-25T10:33:43.170157+0000","last_unstale":"2024-04-25T10:35:36.422129+0000","last_undegraded":"2024-04-25T10:35:36.422129+0000","last_fullsized":"2024-04-25T10:35:36.422129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'21","last_scrub_stamp":"2024-04-25T10:35:36.421981+0000","last_deep_scrub":"23'21","last_deep_scrub_stamp":"2024-04-25T10:35:36.421981+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.421981+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:00.599414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"23'1","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.318072+0000","last_change":"2024-04-25T10:35:30.318072+0000","last_active":"2024-04-25T10:35:30.318072+0000","last_peered":"2024-04-25T10:35:30.318072+0000","last_clean":"2024-04-25T10:35:30.318072+0000","last_became_active":"2024-04-25T10:33:42.160880+0000","last_became_peered":"2024-04-25T10:33:42.160880+0000","last_unstale":"2024-04-25T10:35:30.318072+0000","last_undegraded":"2024-04-25T10:35:30.318072+0000","last_fullsized":"2024-04-25T10:35:30.318072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-04-25T10:35:30.317936+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-04-25T10:35:30.317936+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.317936+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:50.283040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'11","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.690584+0000","last_change":"2024-04-25T10:35:32.690584+0000","last_active":"2024-04-25T10:35:32.690584+0000","last_peered":"2024-04-25T10:35:32.690584+0000","last_clean":"2024-04-25T10:35:32.690584+0000","last_became_active":"2024-04-25T10:33:43.172126+0000","last_became_peered":"2024-04-25T10:33:43.172126+0000","last_unstale":"2024-04-25T10:35:32.690584+0000","last_undegraded":"2024-04-25T10:35:32.690584+0000","last_fullsized":"2024-04-25T10:35:32.690584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-04-25T10:35:32.690428+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-04-25T10:35:32.690428+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.690428+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:10.306243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:32.479478+0000","last_change":"2024-04-25T10:35:32.479478+0000","last_active":"2024-04-25T10:35:32.479478+0000","last_peered":"2024-04-25T10:35:32.479478+0000","last_clean":"2024-04-25T10:35:32.479478+0000","last_became_active":"2024-04-25T10:33:42.160837+0000","last_became_peered":"2024-04-25T10:33:42.160837+0000","last_unstale":"2024-04-25T10:35:32.479478+0000","last_undegraded":"2024-04-25T10:35:32.479478+0000","last_fullsized":"2024-04-25T10:35:32.479478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:32.479336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:32.479336+0000","last_clean_scrub_stamp":"2024-04-25T10:35:32.479336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:44:31.269596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"23'13","reported_seq":41,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.356463+0000","last_change":"2024-04-25T10:35:37.356463+0000","last_active":"2024-04-25T10:35:37.356463+0000","last_peered":"2024-04-25T10:35:37.356463+0000","last_clean":"2024-04-25T10:35:37.356463+0000","last_became_active":"2024-04-25T10:33:43.173910+0000","last_became_peered":"2024-04-25T10:33:43.173910+0000","last_unstale":"2024-04-25T10:35:37.356463+0000","last_undegraded":"2024-04-25T10:35:37.356463+0000","last_fullsized":"2024-04-25T10:35:37.356463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-04-25T10:35:37.356334+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-04-25T10:35:37.356334+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.356334+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:21.203163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:37.842174+0000","last_change":"2024-04-25T10:35:37.842174+0000","last_active":"2024-04-25T10:35:37.842174+0000","last_peered":"2024-04-25T10:35:37.842174+0000","last_clean":"2024-04-25T10:35:37.842174+0000","last_became_active":"2024-04-25T10:33:42.169955+0000","last_became_peered":"2024-04-25T10:33:42.169955+0000","last_unstale":"2024-04-25T10:35:37.842174+0000","last_undegraded":"2024-04-25T10:35:37.842174+0000","last_fullsized":"2024-04-25T10:35:37.842174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:37.842019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:37.842019+0000","last_clean_scrub_stamp":"2024-04-25T10:35:37.842019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:37.509353+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"23'16","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.414081+0000","last_change":"2024-04-25T10:35:34.414081+0000","last_active":"2024-04-25T10:35:34.414081+0000","last_peered":"2024-04-25T10:35:34.414081+0000","last_clean":"2024-04-25T10:35:34.414081+0000","last_became_active":"2024-04-25T10:33:43.169982+0000","last_became_peered":"2024-04-25T10:33:43.169982+0000","last_unstale":"2024-04-25T10:35:34.414081+0000","last_undegraded":"2024-04-25T10:35:34.414081+0000","last_fullsized":"2024-04-25T10:35:34.414081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:34.413916+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:34.413916+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.413916+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:36.557654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'6","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.511357+0000","last_change":"2024-04-25T10:35:30.511357+0000","last_active":"2024-04-25T10:35:30.511357+0000","last_peered":"2024-04-25T10:35:30.511357+0000","last_clean":"2024-04-25T10:35:30.511357+0000","last_became_active":"2024-04-25T10:33:42.159693+0000","last_became_peered":"2024-04-25T10:33:42.159693+0000","last_unstale":"2024-04-25T10:35:30.511357+0000","last_undegraded":"2024-04-25T10:35:30.511357+0000","last_fullsized":"2024-04-25T10:35:30.511357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-04-25T10:35:30.511205+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-04-25T10:35:30.511205+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.511205+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:38.856803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'15","reported_seq":43,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:41.812553+0000","last_change":"2024-04-25T10:35:41.812553+0000","last_active":"2024-04-25T10:35:41.812553+0000","last_peered":"2024-04-25T10:35:41.812553+0000","last_clean":"2024-04-25T10:35:41.812553+0000","last_became_active":"2024-04-25T10:33:43.181133+0000","last_became_peered":"2024-04-25T10:33:43.181133+0000","last_unstale":"2024-04-25T10:35:41.812553+0000","last_undegraded":"2024-04-25T10:35:41.812553+0000","last_fullsized":"2024-04-25T10:35:41.812553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'15","last_scrub_stamp":"2024-04-25T10:35:41.812389+0000","last_deep_scrub":"23'15","last_deep_scrub_stamp":"2024-04-25T10:35:41.812389+0000","last_clean_scrub_stamp":"2024-04-25T10:35:41.812389+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:23.257594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"23'3","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.489079+0000","last_change":"2024-04-25T10:35:33.489079+0000","last_active":"2024-04-25T10:35:33.489079+0000","last_peered":"2024-04-25T10:35:33.489079+0000","last_clean":"2024-04-25T10:35:33.489079+0000","last_became_active":"2024-04-25T10:33:42.165397+0000","last_became_peered":"2024-04-25T10:33:42.165397+0000","last_unstale":"2024-04-25T10:35:33.489079+0000","last_undegraded":"2024-04-25T10:35:33.489079+0000","last_fullsized":"2024-04-25T10:35:33.489079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-04-25T10:35:33.488949+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-04-25T10:35:33.488949+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.488949+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:27.753722+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'19","reported_seq":47,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.569243+0000","last_change":"2024-04-25T10:35:35.569243+0000","last_active":"2024-04-25T10:35:35.569243+0000","last_peered":"2024-04-25T10:35:35.569243+0000","last_clean":"2024-04-25T10:35:35.569243+0000","last_became_active":"2024-04-25T10:33:43.172785+0000","last_became_peered":"2024-04-25T10:33:43.172785+0000","last_unstale":"2024-04-25T10:35:35.569243+0000","last_undegraded":"2024-04-25T10:35:35.569243+0000","last_fullsized":"2024-04-25T10:35:35.569243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'19","last_scrub_stamp":"2024-04-25T10:35:35.569057+0000","last_deep_scrub":"23'19","last_deep_scrub_stamp":"2024-04-25T10:35:35.569057+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.569057+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:58.288488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.751432+0000","last_change":"2024-04-25T10:35:34.751432+0000","last_active":"2024-04-25T10:35:34.751432+0000","last_peered":"2024-04-25T10:35:34.751432+0000","last_clean":"2024-04-25T10:35:34.751432+0000","last_became_active":"2024-04-25T10:33:42.166482+0000","last_became_peered":"2024-04-25T10:33:42.166482+0000","last_unstale":"2024-04-25T10:35:34.751432+0000","last_undegraded":"2024-04-25T10:35:34.751432+0000","last_fullsized":"2024-04-25T10:35:34.751432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:34.751247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:34.751247+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.751247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:20:32.333872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'7","reported_seq":35,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.600720+0000","last_change":"2024-04-25T10:35:30.600720+0000","last_active":"2024-04-25T10:35:30.600720+0000","last_peered":"2024-04-25T10:35:30.600720+0000","last_clean":"2024-04-25T10:35:30.600720+0000","last_became_active":"2024-04-25T10:33:43.170179+0000","last_became_peered":"2024-04-25T10:33:43.170179+0000","last_unstale":"2024-04-25T10:35:30.600720+0000","last_undegraded":"2024-04-25T10:35:30.600720+0000","last_fullsized":"2024-04-25T10:35:30.600720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'7","last_scrub_stamp":"2024-04-25T10:35:30.600541+0000","last_deep_scrub":"23'7","last_deep_scrub_stamp":"2024-04-25T10:35:30.600541+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.600541+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:05:23.775430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:33.448309+0000","last_change":"2024-04-25T10:35:33.448309+0000","last_active":"2024-04-25T10:35:33.448309+0000","last_peered":"2024-04-25T10:35:33.448309+0000","last_clean":"2024-04-25T10:35:33.448309+0000","last_became_active":"2024-04-25T10:33:42.164860+0000","last_became_peered":"2024-04-25T10:33:42.164860+0000","last_unstale":"2024-04-25T10:35:33.448309+0000","last_undegraded":"2024-04-25T10:35:33.448309+0000","last_fullsized":"2024-04-25T10:35:33.448309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:33.448162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:33.448162+0000","last_clean_scrub_stamp":"2024-04-25T10:35:33.448162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:51.868172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'16","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.808266+0000","last_change":"2024-04-25T10:35:35.808266+0000","last_active":"2024-04-25T10:35:35.808266+0000","last_peered":"2024-04-25T10:35:35.808266+0000","last_clean":"2024-04-25T10:35:35.808266+0000","last_became_active":"2024-04-25T10:33:43.167801+0000","last_became_peered":"2024-04-25T10:33:43.167801+0000","last_unstale":"2024-04-25T10:35:35.808266+0000","last_undegraded":"2024-04-25T10:35:35.808266+0000","last_fullsized":"2024-04-25T10:35:35.808266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:35.808128+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:35.808128+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.808128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:33:43.070075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.552926+0000","last_change":"2024-04-25T10:35:29.552926+0000","last_active":"2024-04-25T10:35:29.552926+0000","last_peered":"2024-04-25T10:35:29.552926+0000","last_clean":"2024-04-25T10:35:29.552926+0000","last_became_active":"2024-04-25T10:33:42.156075+0000","last_became_peered":"2024-04-25T10:33:42.156075+0000","last_unstale":"2024-04-25T10:35:29.552926+0000","last_undegraded":"2024-04-25T10:35:29.552926+0000","last_fullsized":"2024-04-25T10:35:29.552926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:35:29.552814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:35:29.552814+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.552814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:55.698031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"23'18","reported_seq":46,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.795209+0000","last_change":"2024-04-25T10:35:34.795209+0000","last_active":"2024-04-25T10:35:34.795209+0000","last_peered":"2024-04-25T10:35:34.795209+0000","last_clean":"2024-04-25T10:35:34.795209+0000","last_became_active":"2024-04-25T10:33:43.167058+0000","last_became_peered":"2024-04-25T10:33:43.167058+0000","last_unstale":"2024-04-25T10:35:34.795209+0000","last_undegraded":"2024-04-25T10:35:34.795209+0000","last_fullsized":"2024-04-25T10:35:34.795209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'18","last_scrub_stamp":"2024-04-25T10:35:34.795026+0000","last_deep_scrub":"23'18","last_deep_scrub_stamp":"2024-04-25T10:35:34.795026+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.795026+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:41:32.735298+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'4","reported_seq":34,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:36.802149+0000","last_change":"2024-04-25T10:35:36.802149+0000","last_active":"2024-04-25T10:35:36.802149+0000","last_peered":"2024-04-25T10:35:36.802149+0000","last_clean":"2024-04-25T10:35:36.802149+0000","last_became_active":"2024-04-25T10:33:42.168216+0000","last_became_peered":"2024-04-25T10:33:42.168216+0000","last_unstale":"2024-04-25T10:35:36.802149+0000","last_undegraded":"2024-04-25T10:35:36.802149+0000","last_fullsized":"2024-04-25T10:35:36.802149+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-04-25T10:35:36.802012+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-04-25T10:35:36.802012+0000","last_clean_scrub_stamp":"2024-04-25T10:35:36.802012+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:43.221645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"23'14","reported_seq":42,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.502174+0000","last_change":"2024-04-25T10:35:35.502174+0000","last_active":"2024-04-25T10:35:35.502174+0000","last_peered":"2024-04-25T10:35:35.502174+0000","last_clean":"2024-04-25T10:35:35.502174+0000","last_became_active":"2024-04-25T10:33:43.174288+0000","last_became_peered":"2024-04-25T10:33:43.174288+0000","last_unstale":"2024-04-25T10:35:35.502174+0000","last_undegraded":"2024-04-25T10:35:35.502174+0000","last_fullsized":"2024-04-25T10:35:35.502174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'14","last_scrub_stamp":"2024-04-25T10:35:35.502032+0000","last_deep_scrub":"23'14","last_deep_scrub_stamp":"2024-04-25T10:35:35.502032+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.502032+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:59.420959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"23'23","reported_seq":50,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:41.409149+0000","last_change":"2024-04-25T10:35:41.409203+0000","last_active":"2024-04-25T10:35:41.409149+0000","last_peered":"2024-04-25T10:35:41.409149+0000","last_clean":"2024-04-25T10:35:41.409149+0000","last_became_active":"2024-04-25T10:33:43.176046+0000","last_became_peered":"2024-04-25T10:33:43.176046+0000","last_unstale":"2024-04-25T10:35:41.409149+0000","last_undegraded":"2024-04-25T10:35:41.409149+0000","last_fullsized":"2024-04-25T10:35:41.409149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'23","last_scrub_stamp":"2024-04-25T10:35:41.409025+0000","last_deep_scrub":"23'23","last_deep_scrub_stamp":"2024-04-25T10:35:41.409025+0000","last_clean_scrub_stamp":"2024-04-25T10:35:41.409025+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:42.011099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"23'3","reported_seq":32,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.791640+0000","last_change":"2024-04-25T10:35:35.791678+0000","last_active":"2024-04-25T10:35:35.791640+0000","last_peered":"2024-04-25T10:35:35.791640+0000","last_clean":"2024-04-25T10:35:35.791640+0000","last_became_active":"2024-04-25T10:33:42.168317+0000","last_became_peered":"2024-04-25T10:33:42.168317+0000","last_unstale":"2024-04-25T10:35:35.791640+0000","last_undegraded":"2024-04-25T10:35:35.791640+0000","last_fullsized":"2024-04-25T10:35:35.791640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'3","last_scrub_stamp":"2024-04-25T10:35:35.791538+0000","last_deep_scrub":"23'3","last_deep_scrub_stamp":"2024-04-25T10:35:35.791538+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.791538+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:05:51.091506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'13","reported_seq":40,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:35.333974+0000","last_change":"2024-04-25T10:35:35.334021+0000","last_active":"2024-04-25T10:35:35.333974+0000","last_peered":"2024-04-25T10:35:35.333974+0000","last_clean":"2024-04-25T10:35:35.333974+0000","last_became_active":"2024-04-25T10:33:43.170600+0000","last_became_peered":"2024-04-25T10:33:43.170600+0000","last_unstale":"2024-04-25T10:35:35.333974+0000","last_undegraded":"2024-04-25T10:35:35.333974+0000","last_fullsized":"2024-04-25T10:35:35.333974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'13","last_scrub_stamp":"2024-04-25T10:35:35.333820+0000","last_deep_scrub":"23'13","last_deep_scrub_stamp":"2024-04-25T10:35:35.333820+0000","last_clean_scrub_stamp":"2024-04-25T10:35:35.333820+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:55.300630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'4","reported_seq":33,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:38.832002+0000","last_change":"2024-04-25T10:35:38.832049+0000","last_active":"2024-04-25T10:35:38.832002+0000","last_peered":"2024-04-25T10:35:38.832002+0000","last_clean":"2024-04-25T10:35:38.832002+0000","last_became_active":"2024-04-25T10:33:42.170968+0000","last_became_peered":"2024-04-25T10:33:42.170968+0000","last_unstale":"2024-04-25T10:35:38.832002+0000","last_undegraded":"2024-04-25T10:35:38.832002+0000","last_fullsized":"2024-04-25T10:35:38.832002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'4","last_scrub_stamp":"2024-04-25T10:35:38.831897+0000","last_deep_scrub":"23'4","last_deep_scrub_stamp":"2024-04-25T10:35:38.831897+0000","last_clean_scrub_stamp":"2024-04-25T10:35:38.831897+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:28.622701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"23'16","reported_seq":44,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:34.583242+0000","last_change":"2024-04-25T10:35:34.583242+0000","last_active":"2024-04-25T10:35:34.583242+0000","last_peered":"2024-04-25T10:35:34.583242+0000","last_clean":"2024-04-25T10:35:34.583242+0000","last_became_active":"2024-04-25T10:33:43.172242+0000","last_became_peered":"2024-04-25T10:33:43.172242+0000","last_unstale":"2024-04-25T10:35:34.583242+0000","last_undegraded":"2024-04-25T10:35:34.583242+0000","last_fullsized":"2024-04-25T10:35:34.583242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'16","last_scrub_stamp":"2024-04-25T10:35:34.583103+0000","last_deep_scrub":"23'16","last_deep_scrub_stamp":"2024-04-25T10:35:34.583103+0000","last_clean_scrub_stamp":"2024-04-25T10:35:34.583103+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:36.726841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":31,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:30.778041+0000","last_change":"2024-04-25T10:35:30.778041+0000","last_active":"2024-04-25T10:35:30.778041+0000","last_peered":"2024-04-25T10:35:30.778041+0000","last_clean":"2024-04-25T10:35:30.778041+0000","last_became_active":"2024-04-25T10:33:42.161074+0000","last_became_peered":"2024-04-25T10:33:42.161074+0000","last_unstale":"2024-04-25T10:35:30.778041+0000","last_undegraded":"2024-04-25T10:35:30.778041+0000","last_fullsized":"2024-04-25T10:35:30.778041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'1","last_scrub_stamp":"2024-04-25T10:35:30.777933+0000","last_deep_scrub":"19'1","last_deep_scrub_stamp":"2024-04-25T10:35:30.777933+0000","last_clean_scrub_stamp":"2024-04-25T10:35:30.777933+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:52:24.581058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'11","reported_seq":39,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:39.823633+0000","last_change":"2024-04-25T10:35:39.823633+0000","last_active":"2024-04-25T10:35:39.823633+0000","last_peered":"2024-04-25T10:35:39.823633+0000","last_clean":"2024-04-25T10:35:39.823633+0000","last_became_active":"2024-04-25T10:33:43.177298+0000","last_became_peered":"2024-04-25T10:33:43.177298+0000","last_unstale":"2024-04-25T10:35:39.823633+0000","last_undegraded":"2024-04-25T10:35:39.823633+0000","last_fullsized":"2024-04-25T10:35:39.823633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'11","last_scrub_stamp":"2024-04-25T10:35:39.823422+0000","last_deep_scrub":"23'11","last_deep_scrub_stamp":"2024-04-25T10:35:39.823422+0000","last_clean_scrub_stamp":"2024-04-25T10:35:39.823422+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:51:23.670251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"23'6","reported_seq":36,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-25T10:35:29.510754+0000","last_change":"2024-04-25T10:35:29.510754+0000","last_active":"2024-04-25T10:35:29.510754+0000","last_peered":"2024-04-25T10:35:29.510754+0000","last_clean":"2024-04-25T10:35:29.510754+0000","last_became_active":"2024-04-25T10:33:42.166699+0000","last_became_peered":"2024-04-25T10:33:42.166699+0000","last_unstale":"2024-04-25T10:35:29.510754+0000","last_undegraded":"2024-04-25T10:35:29.510754+0000","last_fullsized":"2024-04-25T10:35:29.510754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'6","last_scrub_stamp":"2024-04-25T10:35:29.510650+0000","last_deep_scrub":"23'6","last_deep_scrub_stamp":"2024-04-25T10:35:29.510650+0000","last_clean_scrub_stamp":"2024-04-25T10:35:29.510650+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:55.655868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":42,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":151678,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":167,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":303356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":851968,"data_stored":680186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":238996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":249856,"data_stored":89320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":89356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":240116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":253952,"data_stored":90344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":258048,"data_stored":89393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":856064,"data_stored":680239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":150880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":149769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:36:11.844 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T10:36:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.984+0000 7fa56b030640 1 Processor -- start 2024-04-25T10:36:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.984+0000 7fa56b030640 1 -- start start 2024-04-25T10:36:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.985+0000 7fa56b030640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa564141360 0x7fa564141770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.985+0000 7fa56b030640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5641473f0 0x7fa564147800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.985+0000 7fa56b030640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56406c960 con 0x7fa5640b8c40 2024-04-25T10:36:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.985+0000 7fa56b030640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa56406cc40 con 0x7fa564141360 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.985+0000 7fa56b030640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa56406cf20 con 0x7fa5641473f0 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.985+0000 7fa563fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa564141360 0x7fa564141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.985+0000 7fa568dcc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa5640b8c40 0x7fa5640b6c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60610/0 (socket says 172.21.15.103:60610) 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.985+0000 7fa568dcc640 1 -- 172.21.15.103:0/1244049877 learned_addr learned my addr 172.21.15.103:0/1244049877 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.986+0000 7fa5695cd640 1 --2- 172.21.15.103:0/1244049877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5641473f0 0x7fa564147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.986+0000 7fa563fff640 1 -- 172.21.15.103:0/1244049877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5641473f0 msgr2=0x7fa564147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.986+0000 7fa563fff640 1 --2- 172.21.15.103:0/1244049877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5641473f0 0x7fa564147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.986+0000 7fa563fff640 1 -- 172.21.15.103:0/1244049877 >> v1:172.21.15.103:6789/0 conn(0x7fa5640b8c40 legacy=0x7fa5640b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.986+0000 7fa5637fe640 1 -- 172.21.15.103:0/1244049877 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898123447 0 0) 0x7fa56406c960 con 0x7fa5640b8c40 2024-04-25T10:36:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.986+0000 7fa563fff640 1 -- 172.21.15.103:0/1244049877 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5640b9050 con 0x7fa564141360 2024-04-25T10:36:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.986+0000 7fa563fff640 1 --2- 172.21.15.103:0/1244049877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564141770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa5580097a0 tx=0x7fa55802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc9cd927688b936 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa5637fe640 1 -- 172.21.15.103:0/1244049877 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558037070 con 0x7fa564141360 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa5637fe640 1 -- 172.21.15.103:0/1244049877 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55802adb0 con 0x7fa564141360 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa5637fe640 1 -- 172.21.15.103:0/1244049877 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558032660 con 0x7fa564141360 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa56b030640 1 -- 172.21.15.103:0/1244049877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 msgr2=0x7fa564141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa56b030640 1 --2- 172.21.15.103:0/1244049877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564141770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa5580097a0 tx=0x7fa55802a060 comp rx=0 tx=0).stop 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa56b030640 1 -- 172.21.15.103:0/1244049877 shutdown_connections 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa56b030640 1 --2- 172.21.15.103:0/1244049877 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5641473f0 0x7fa564147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa56b030640 1 --2- 172.21.15.103:0/1244049877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564141770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa56b030640 1 -- 172.21.15.103:0/1244049877 >> 172.21.15.103:0/1244049877 conn(0x7fa5640bc160 msgr2=0x7fa5640b8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa56b030640 1 -- 172.21.15.103:0/1244049877 shutdown_connections 2024-04-25T10:36:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.987+0000 7fa56b030640 1 -- 172.21.15.103:0/1244049877 wait complete. 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.989+0000 7fa56b030640 1 Processor -- start 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.989+0000 7fa56b030640 1 -- start start 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa56b030640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5640b8c40 0x7fa564142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa56b030640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564139bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa56b030640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5641473f0 0x7fa5641369b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa56b030640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa56406c740 con 0x7fa564141360 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa56b030640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa56406c5c0 con 0x7fa5641473f0 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa56b030640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa564151d30 con 0x7fa5640b8c40 2024-04-25T10:36:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa563fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564139bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa563fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564139bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45418/0 (socket says 172.21.15.103:45418) 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa563fff640 1 -- 172.21.15.103:0/2967116169 learned_addr learned my addr 172.21.15.103:0/2967116169 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa568dcc640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5640b8c40 0x7fa564142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa5695cd640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5641473f0 0x7fa5641369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa563fff640 1 -- 172.21.15.103:0/2967116169 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5640b8c40 msgr2=0x7fa564142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa563fff640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5640b8c40 0x7fa564142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa563fff640 1 -- 172.21.15.103:0/2967116169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5641473f0 msgr2=0x7fa5641369b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa563fff640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5641473f0 0x7fa5641369b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.990+0000 7fa563fff640 1 -- 172.21.15.103:0/2967116169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5641dd4a0 con 0x7fa564141360 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.991+0000 7fa563fff640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564139bc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa558000c00 tx=0x7fa5580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.991+0000 7fa5617fa640 1 -- 172.21.15.103:0/2967116169 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558042070 con 0x7fa564141360 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.991+0000 7fa5617fa640 1 -- 172.21.15.103:0/2967116169 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55803e670 con 0x7fa564141360 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.991+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5641dd780 con 0x7fa564141360 2024-04-25T10:36:11.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.991+0000 7fa5617fa640 1 -- 172.21.15.103:0/2967116169 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558037040 con 0x7fa564141360 2024-04-25T10:36:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.991+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa564143380 con 0x7fa564141360 2024-04-25T10:36:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.992+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56406a130 con 0x7fa564141360 2024-04-25T10:36:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.992+0000 7fa5617fa640 1 -- 172.21.15.103:0/2967116169 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa558045070 con 0x7fa564141360 2024-04-25T10:36:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.993+0000 7fa5617fa640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa5500744e0 0x7fa5500769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.993+0000 7fa568dcc640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa5500744e0 0x7fa5500769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:11.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.993+0000 7fa5617fa640 1 -- 172.21.15.103:0/2967116169 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fa5580b5920 con 0x7fa564141360 2024-04-25T10:36:11.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.993+0000 7fa568dcc640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa5500744e0 0x7fa5500769f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa554007fd0 tx=0x7fa554007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:11.997+0000 7fa5617fa640 1 -- 172.21.15.103:0/2967116169 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa55807fa50 con 0x7fa564141360 2024-04-25T10:36:12.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.172+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa5641455b0 con 0x7fa564141360 2024-04-25T10:36:12.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.175+0000 7fa5617fa640 1 -- 172.21.15.103:0/2967116169 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fa558088090 con 0x7fa564141360 2024-04-25T10:36:12.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.177+0000 7fa5617fa640 1 -- 172.21.15.103:0/2967116169 <== mon.0 v2:172.21.15.103:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa55807f560 con 0x7fa564141360 2024-04-25T10:36:12.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa5500744e0 msgr2=0x7fa5500769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa5500744e0 0x7fa5500769f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa554007fd0 tx=0x7fa554007de0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 msgr2=0x7fa564139bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564139bc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa558000c00 tx=0x7fa5580046c0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 shutdown_connections 2024-04-25T10:36:12.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa5500744e0 0x7fa5500769f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5641473f0 0x7fa5641369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa564141360 0x7fa564139bc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 --2- 172.21.15.103:0/2967116169 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa5640b8c40 0x7fa564142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.178+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 >> 172.21.15.103:0/2967116169 conn(0x7fa5640bc160 msgr2=0x7fa564075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:12.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.179+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 shutdown_connections 2024-04-25T10:36:12.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.179+0000 7fa56b030640 1 -- 172.21.15.103:0/2967116169 wait complete. 2024-04-25T10:36:12.192 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:36:12.193 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:36:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.299+0000 7fb08e6a7640 1 Processor -- start 2024-04-25T10:36:12.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.299+0000 7fb08e6a7640 1 -- start start 2024-04-25T10:36:12.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.300+0000 7fb08e6a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb088071e50 0x7fb08814cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.300+0000 7fb08e6a7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08814d050 0x7fb088153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.300+0000 7fb08e6a7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb08806e960 con 0x7fb0880b2fe0 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.300+0000 7fb08e6a7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb08806de80 con 0x7fb088071e50 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.300+0000 7fb08e6a7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fb08806e160 con 0x7fb08814d050 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb08cc44640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08814d050 0x7fb088153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb0877fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb088071e50 0x7fb08814cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb087fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb0880b2fe0 0x7fb0880b8300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.103:55310/0 (socket says 172.21.15.103:55310) 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb0877fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb088071e50 0x7fb08814cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.103:38836/0 (socket says 172.21.15.103:38836) 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb08cc44640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08814d050 0x7fb088153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.103:40902/0 (socket says 172.21.15.103:40902) 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb087fff640 1 -- 172.21.15.103:0/4284521253 learned_addr learned my addr 172.21.15.103:0/4284521253 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb08cc44640 1 -- 172.21.15.103:0/4284521253 >> v2:172.21.15.132:3300/0 conn(0x7fb088071e50 msgr2=0x7fb08814cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb08cc44640 1 --2- 172.21.15.103:0/4284521253 >> v2:172.21.15.132:3300/0 conn(0x7fb088071e50 0x7fb08814cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb08cc44640 1 -- 172.21.15.103:0/4284521253 >> v1:172.21.15.132:6789/0 conn(0x7fb0880b2fe0 legacy=0x7fb0880b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb08cc44640 1 -- 172.21.15.103:0/4284521253 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08806e440 con 0x7fb08814d050 2024-04-25T10:36:12.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.301+0000 7fb0877fe640 1 --2- 172.21.15.103:0/4284521253 >> v2:172.21.15.132:3300/0 conn(0x7fb088071e50 0x7fb08814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.302+0000 7fb08cc44640 1 --2- 172.21.15.103:0/4284521253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08814d050 0x7fb088153ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb080009d90 tx=0x7fb08002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40606f6474e1a789 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.302+0000 7fb086ffd640 1 -- 172.21.15.103:0/4284521253 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080007740 con 0x7fb08814d050 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.302+0000 7fb086ffd640 1 -- 172.21.15.103:0/4284521253 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb0800078e0 con 0x7fb08814d050 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.302+0000 7fb086ffd640 1 -- 172.21.15.103:0/4284521253 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080007cd0 con 0x7fb08814d050 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.303+0000 7fb08e6a7640 1 -- 172.21.15.103:0/4284521253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08814d050 msgr2=0x7fb088153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.303+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/4284521253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08814d050 0x7fb088153ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb080009d90 tx=0x7fb08002a6f0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.303+0000 7fb08e6a7640 1 -- 172.21.15.103:0/4284521253 shutdown_connections 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.303+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/4284521253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb08814d050 0x7fb088153ea0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.303+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/4284521253 >> v2:172.21.15.132:3300/0 conn(0x7fb088071e50 0x7fb08814cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.303+0000 7fb08e6a7640 1 -- 172.21.15.103:0/4284521253 >> 172.21.15.103:0/4284521253 conn(0x7fb0880b93f0 msgr2=0x7fb0880b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.303+0000 7fb08e6a7640 1 -- 172.21.15.103:0/4284521253 shutdown_connections 2024-04-25T10:36:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.303+0000 7fb08e6a7640 1 -- 172.21.15.103:0/4284521253 wait complete. 2024-04-25T10:36:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.304+0000 7fb08e6a7640 1 Processor -- start 2024-04-25T10:36:12.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.304+0000 7fb08e6a7640 1 -- start start 2024-04-25T10:36:12.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.305+0000 7fb08e6a7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb088071e50 0x7fb088147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.305+0000 7fb08e6a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0880b2fe0 0x7fb088148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.305+0000 7fb08e6a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08814d050 0x7fb08813df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.305+0000 7fb08e6a7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb0880b3570 con 0x7fb0880b2fe0 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.305+0000 7fb08e6a7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb0880b33f0 con 0x7fb08814d050 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.305+0000 7fb08e6a7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fb088072260 con 0x7fb088071e50 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.305+0000 7fb0877fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0880b2fe0 0x7fb088148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.305+0000 7fb0877fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0880b2fe0 0x7fb088148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45430/0 (socket says 172.21.15.103:45430) 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb0877fe640 1 -- 172.21.15.103:0/3345170738 learned_addr learned my addr 172.21.15.103:0/3345170738 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb087fff640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb088071e50 0x7fb088147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb08cc44640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08814d050 0x7fb08813df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb0877fe640 1 -- 172.21.15.103:0/3345170738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb088071e50 msgr2=0x7fb088147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb0877fe640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb088071e50 0x7fb088147c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb0877fe640 1 -- 172.21.15.103:0/3345170738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08814d050 msgr2=0x7fb08813df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb0877fe640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08814d050 0x7fb08813df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb0877fe640 1 -- 172.21.15.103:0/3345170738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0881e2bf0 con 0x7fb0880b2fe0 2024-04-25T10:36:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb0877fe640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0880b2fe0 0x7fb088148770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00e8e0 tx=0x7fb07c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb084ff9640 1 -- 172.21.15.103:0/3345170738 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c017070 con 0x7fb0880b2fe0 2024-04-25T10:36:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb084ff9640 1 -- 172.21.15.103:0/3345170738 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb07c00ca00 con 0x7fb0880b2fe0 2024-04-25T10:36:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb088148cb0 con 0x7fb0880b2fe0 2024-04-25T10:36:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb084ff9640 1 -- 172.21.15.103:0/3345170738 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00cdd0 con 0x7fb0880b2fe0 2024-04-25T10:36:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.306+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0881e3150 con 0x7fb0880b2fe0 2024-04-25T10:36:12.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.307+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08806a130 con 0x7fb0880b2fe0 2024-04-25T10:36:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.308+0000 7fb084ff9640 1 -- 172.21.15.103:0/3345170738 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fb07c01a070 con 0x7fb0880b2fe0 2024-04-25T10:36:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.308+0000 7fb084ff9640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb0740744b0 0x7fb0740769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.308+0000 7fb087fff640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb0740744b0 0x7fb0740769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.308+0000 7fb084ff9640 1 -- 172.21.15.103:0/3345170738 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fb07c095280 con 0x7fb0880b2fe0 2024-04-25T10:36:12.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.309+0000 7fb087fff640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb0740744b0 0x7fb0740769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb078000f60 tx=0x7fb078009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:12.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.313+0000 7fb084ff9640 1 -- 172.21.15.103:0/3345170738 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb0881e2bf0 con 0x7fb0880b2fe0 2024-04-25T10:36:12.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.522+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0880bb380 con 0x7fb0880b2fe0 2024-04-25T10:36:12.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.522+0000 7fb084ff9640 1 -- 172.21.15.103:0/3345170738 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3530 (secure 0 0 0) 0x7fb07c05f970 con 0x7fb0880b2fe0 2024-04-25T10:36:12.524 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:36:12.524 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/617098639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":617098639},{"type":"v1","addr":"172.21.15.132:6833","nonce":617098639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:33:42.512740+0000","modified":"2024-04-25T10:33:44.518295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/2389441335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2389441335},{"type":"v1","addr":"172.21.15.103:6835","nonce":2389441335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-25T10:36:12.524 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb0740744b0 msgr2=0x7fb0740769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb0740744b0 0x7fb0740769c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb078000f60 tx=0x7fb078009040 comp rx=0 tx=0).stop 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0880b2fe0 msgr2=0x7fb088148770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0880b2fe0 0x7fb088148770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00e8e0 tx=0x7fb07c00eda0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 shutdown_connections 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fb0740744b0 0x7fb0740769c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb08814d050 0x7fb08813df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0880b2fe0 0x7fb088148770 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 --2- 172.21.15.103:0/3345170738 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb088071e50 0x7fb088147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 >> 172.21.15.103:0/3345170738 conn(0x7fb0880b93f0 msgr2=0x7fb0880b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:12.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 shutdown_connections 2024-04-25T10:36:12.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.524+0000 7fb08e6a7640 1 -- 172.21.15.103:0/3345170738 wait complete. 2024-04-25T10:36:12.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:36:12.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.643+0000 7fa0aff72640 1 Processor -- start 2024-04-25T10:36:12.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.643+0000 7fa0aff72640 1 -- start start 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.644+0000 7fa0aff72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa0a80720e0 0x7fa0a80b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.644+0000 7fa0aff72640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80b23b0 0x7fa0a80b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.644+0000 7fa0aff72640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a80b27c0 con 0x7fa0a81472a0 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.644+0000 7fa0aff72640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a8071970 con 0x7fa0a80720e0 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.644+0000 7fa0aff72640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a80b2a80 con 0x7fa0a80b23b0 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0ae50f640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa0a81472a0 0x7fa0a80b5fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60612/0 (socket says 172.21.15.103:60612) 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0ae50f640 1 -- 172.21.15.103:0/2636632993 learned_addr learned my addr 172.21.15.103:0/2636632993 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0add0e640 1 --2- 172.21.15.103:0/2636632993 >> v2:172.21.15.132:3300/0 conn(0x7fa0a80720e0 0x7fa0a80b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0ad50d640 1 --2- 172.21.15.103:0/2636632993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80b23b0 0x7fa0a80b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0acd0c640 1 -- 172.21.15.103:0/2636632993 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651667948 0 0) 0x7fa0a80b27c0 con 0x7fa0a81472a0 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0acd0c640 1 -- 172.21.15.103:0/2636632993 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa094003520 con 0x7fa0a81472a0 2024-04-25T10:36:12.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0add0e640 1 -- 172.21.15.103:0/2636632993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80b23b0 msgr2=0x7fa0a80b84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0add0e640 1 --2- 172.21.15.103:0/2636632993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80b23b0 0x7fa0a80b84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0acd0c640 1 -- 172.21.15.103:0/2636632993 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1199002305 0 0) 0x7fa094003520 con 0x7fa0a81472a0 2024-04-25T10:36:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0add0e640 1 -- 172.21.15.103:0/2636632993 >> v1:172.21.15.103:6789/0 conn(0x7fa0a81472a0 legacy=0x7fa0a80b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.645+0000 7fa0add0e640 1 -- 172.21.15.103:0/2636632993 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a8071bc0 con 0x7fa0a80720e0 2024-04-25T10:36:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.646+0000 7fa0add0e640 1 --2- 172.21.15.103:0/2636632993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a80720e0 0x7fa0a80b1df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40097a0 tx=0x7fa0a402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=433eb1bc8514e69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.646+0000 7fa0acd0c640 1 -- 172.21.15.103:0/2636632993 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4037070 con 0x7fa0a80720e0 2024-04-25T10:36:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.646+0000 7fa0acd0c640 1 -- 172.21.15.103:0/2636632993 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa0a402ab10 con 0x7fa0a80720e0 2024-04-25T10:36:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.646+0000 7fa0acd0c640 1 -- 172.21.15.103:0/2636632993 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00019f0 con 0x7fa0a80720e0 2024-04-25T10:36:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.647+0000 7fa0aff72640 1 -- 172.21.15.103:0/2636632993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a80720e0 msgr2=0x7fa0a80b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.647+0000 7fa0aff72640 1 --2- 172.21.15.103:0/2636632993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a80720e0 0x7fa0a80b1df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40097a0 tx=0x7fa0a402a080 comp rx=0 tx=0).stop 2024-04-25T10:36:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.647+0000 7fa0aff72640 1 -- 172.21.15.103:0/2636632993 shutdown_connections 2024-04-25T10:36:12.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.647+0000 7fa0aff72640 1 --2- 172.21.15.103:0/2636632993 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80b23b0 0x7fa0a80b84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.647+0000 7fa0aff72640 1 --2- 172.21.15.103:0/2636632993 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a80720e0 0x7fa0a80b1df0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.647+0000 7fa0aff72640 1 -- 172.21.15.103:0/2636632993 >> 172.21.15.103:0/2636632993 conn(0x7fa0a80b93f0 msgr2=0x7fa0a80b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.647+0000 7fa0aff72640 1 -- 172.21.15.103:0/2636632993 shutdown_connections 2024-04-25T10:36:12.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.647+0000 7fa0aff72640 1 -- 172.21.15.103:0/2636632993 wait complete. 2024-04-25T10:36:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.648+0000 7fa0aff72640 1 Processor -- start 2024-04-25T10:36:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.648+0000 7fa0aff72640 1 -- start start 2024-04-25T10:36:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0aff72640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80720e0 0x7fa0a8141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0aff72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a80b23b0 0x7fa0a81d6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0aff72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a81472a0 0x7fa0a80a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0aff72640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a8147830 con 0x7fa0a80b23b0 2024-04-25T10:36:12.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0aff72640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81476b0 con 0x7fa0a81472a0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0aff72640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a8151bc0 con 0x7fa0a80720e0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0ad50d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a80b23b0 0x7fa0a81d6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0ad50d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a80b23b0 0x7fa0a81d6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45444/0 (socket says 172.21.15.103:45444) 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0ad50d640 1 -- 172.21.15.103:0/1470714562 learned_addr learned my addr 172.21.15.103:0/1470714562 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0add0e640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80720e0 0x7fa0a8141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.649+0000 7fa0ae50f640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a81472a0 0x7fa0a80a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa0ad50d640 1 -- 172.21.15.103:0/1470714562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80720e0 msgr2=0x7fa0a8141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa0ad50d640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80720e0 0x7fa0a8141df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa0ad50d640 1 -- 172.21.15.103:0/1470714562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a81472a0 msgr2=0x7fa0a80a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa0ad50d640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a81472a0 0x7fa0a80a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa0ad50d640 1 -- 172.21.15.103:0/1470714562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a81dd990 con 0x7fa0a80b23b0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa0ad50d640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a80b23b0 0x7fa0a81d6a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa09800e870 tx=0x7fa09800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa09e7fc640 1 -- 172.21.15.103:0/1470714562 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098017070 con 0x7fa0a80b23b0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa09e7fc640 1 -- 172.21.15.103:0/1470714562 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa09800c8e0 con 0x7fa0a80b23b0 2024-04-25T10:36:12.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a81ddc30 con 0x7fa0a80b23b0 2024-04-25T10:36:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa09e7fc640 1 -- 172.21.15.103:0/1470714562 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09800ccf0 con 0x7fa0a80b23b0 2024-04-25T10:36:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.650+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a8144c20 con 0x7fa0a80b23b0 2024-04-25T10:36:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.651+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a806a130 con 0x7fa0a80b23b0 2024-04-25T10:36:12.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.652+0000 7fa09e7fc640 1 -- 172.21.15.103:0/1470714562 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fa09801a070 con 0x7fa0a80b23b0 2024-04-25T10:36:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.652+0000 7fa09e7fc640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa08c0744e0 0x7fa08c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.652+0000 7fa0add0e640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa08c0744e0 0x7fa08c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.652+0000 7fa09e7fc640 1 -- 172.21.15.103:0/1470714562 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fa098095500 con 0x7fa0a80b23b0 2024-04-25T10:36:12.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.652+0000 7fa0add0e640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa08c0744e0 0x7fa08c0769f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4034000 tx=0x7fa0a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:12.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.657+0000 7fa09e7fc640 1 -- 172.21.15.103:0/1470714562 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa09805f5a0 con 0x7fa0a80b23b0 2024-04-25T10:36:12.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.868+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0a8146ec0 con 0x7fa0a80b23b0 2024-04-25T10:36:12.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.869+0000 7fa09e7fc640 1 -- 172.21.15.103:0/1470714562 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+3530 (secure 0 0 0) 0x7fa0980638a0 con 0x7fa0a80b23b0 2024-04-25T10:36:12.871 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:36:12.871 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/617098639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":617098639},{"type":"v1","addr":"172.21.15.132:6833","nonce":617098639}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:33:42.512740+0000","modified":"2024-04-25T10:33:44.518295+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/2389441335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":2389441335},{"type":"v1","addr":"172.21.15.103:6835","nonce":2389441335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-25T10:36:12.871 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-04-25T10:36:12.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.870+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa08c0744e0 msgr2=0x7fa08c0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.870+0000 7fa0aff72640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa08c0744e0 0x7fa08c0769f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4034000 tx=0x7fa0a402e000 comp rx=0 tx=0).stop 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.870+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a80b23b0 msgr2=0x7fa0a81d6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.870+0000 7fa0aff72640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a80b23b0 0x7fa0a81d6a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa09800e870 tx=0x7fa09800ed30 comp rx=0 tx=0).stop 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.871+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 shutdown_connections 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.871+0000 7fa0aff72640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fa08c0744e0 0x7fa08c0769f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.871+0000 7fa0aff72640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0a81472a0 0x7fa0a80a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.871+0000 7fa0aff72640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0a80b23b0 0x7fa0a81d6a50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.871+0000 7fa0aff72640 1 --2- 172.21.15.103:0/1470714562 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa0a80720e0 0x7fa0a8141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.871+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 >> 172.21.15.103:0/1470714562 conn(0x7fa0a80b93f0 msgr2=0x7fa0a8145a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.871+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 shutdown_connections 2024-04-25T10:36:12.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.871+0000 7fa0aff72640 1 -- 172.21.15.103:0/1470714562 wait complete. 2024-04-25T10:36:12.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:36:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.990+0000 7fea76ad8640 1 Processor -- start 2024-04-25T10:36:12.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.990+0000 7fea76ad8640 1 -- start start 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.991+0000 7fea76ad8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fea700b1df0 0x7fea700b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.991+0000 7fea76ad8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea700b84e0 0x7fea700b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.991+0000 7fea76ad8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea700b2a80 con 0x7fea700720e0 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.991+0000 7fea76ad8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fea70071970 con 0x7fea700b1df0 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.991+0000 7fea76ad8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fea70071bc0 con 0x7fea700b84e0 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.991+0000 7fea74874640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fea700720e0 0x7fea701472a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60620/0 (socket says 172.21.15.103:60620) 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.991+0000 7fea74874640 1 -- 172.21.15.103:0/1875265301 learned_addr learned my addr 172.21.15.103:0/1875265301 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea75075640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea700b84e0 0x7fea700b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6ffff640 1 --2- 172.21.15.103:0/1875265301 >> v2:172.21.15.132:3300/0 conn(0x7fea700b1df0 0x7fea700b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2506675050 0 0) 0x7fea700b2a80 con 0x7fea700720e0 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea58003520 con 0x7fea700720e0 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4041692317 0 0) 0x7fea58003520 con 0x7fea700720e0 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea700b84e0 msgr2=0x7fea700b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea700b84e0 0x7fea700b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 >> v2:172.21.15.132:3300/0 conn(0x7fea700b1df0 msgr2=0x7fea700b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 --2- 172.21.15.103:0/1875265301 >> v2:172.21.15.132:3300/0 conn(0x7fea700b1df0 0x7fea700b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea700b88f0 con 0x7fea700720e0 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7fea60001670 con 0x7fea700720e0 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 >> v1:172.21.15.103:6789/0 conn(0x7fea700720e0 legacy=0x7fea701472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea580039b0 0x7fea58003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea58004800 0x7fea58004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea700b84e0 0x7fea58005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fea70071970 con 0x7fea58004800 2024-04-25T10:36:12.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea70071bc0 con 0x7fea580039b0 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fea5800ba70 con 0x7fea700b84e0 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6ffff640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea58004800 0x7fea58004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea74874640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea580039b0 0x7fea58003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea75075640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea700b84e0 0x7fea58005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6ffff640 1 -- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea700b84e0 msgr2=0x7fea58005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6ffff640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea700b84e0 0x7fea58005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6ffff640 1 -- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea580039b0 msgr2=0x7fea58003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6ffff640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea580039b0 0x7fea58003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.992+0000 7fea6ffff640 1 -- 172.21.15.103:0/1875265301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea58003520 con 0x7fea58004800 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.993+0000 7fea6ffff640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea58004800 0x7fea58004c10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fea64009ac0 tx=0x7fea58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36982c8da6f6e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.993+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64036070 con 0x7fea58004800 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.993+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea64031400 con 0x7fea58004800 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.993+0000 7fea6f7fe640 1 -- 172.21.15.103:0/1875265301 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64009690 con 0x7fea58004800 2024-04-25T10:36:12.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.994+0000 7fea76ad8640 1 -- 172.21.15.103:0/1875265301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea58004800 msgr2=0x7fea58004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.994+0000 7fea76ad8640 1 --2- 172.21.15.103:0/1875265301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea58004800 0x7fea58004c10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fea64009ac0 tx=0x7fea58005830 comp rx=0 tx=0).stop 2024-04-25T10:36:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.994+0000 7fea75075640 1 -- 172.21.15.103:0/1875265301 reap_dead start 2024-04-25T10:36:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.994+0000 7fea76ad8640 1 -- 172.21.15.103:0/1875265301 shutdown_connections 2024-04-25T10:36:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.994+0000 7fea76ad8640 1 -- 172.21.15.103:0/1875265301 >> 172.21.15.103:0/1875265301 conn(0x7fea700b93f0 msgr2=0x7fea700b9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.994+0000 7fea76ad8640 1 -- 172.21.15.103:0/1875265301 shutdown_connections 2024-04-25T10:36:12.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.994+0000 7fea76ad8640 1 -- 172.21.15.103:0/1875265301 wait complete. 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.995+0000 7fea76ad8640 1 Processor -- start 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.995+0000 7fea76ad8640 1 -- start start 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.996+0000 7fea76ad8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea58004800 0x7fea700a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea76ad8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea701df5e0 0x7fea700a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea76ad8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea701409e0 0x7fea70140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea76ad8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fea700b6330 con 0x7fea701409e0 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea76ad8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fea700b61b0 con 0x7fea701df5e0 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea76ad8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7fea700b64b0 con 0x7fea58004800 2024-04-25T10:36:13.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea701409e0 0x7fea70140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea701409e0 0x7fea70140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45454/0 (socket says 172.21.15.103:45454) 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 -- 172.21.15.103:0/2973827744 learned_addr learned my addr 172.21.15.103:0/2973827744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea6ffff640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea701df5e0 0x7fea700a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea74874640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea58004800 0x7fea700a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 -- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea58004800 msgr2=0x7fea700a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea58004800 0x7fea700a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 -- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea701df5e0 msgr2=0x7fea700a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea701df5e0 0x7fea700a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 -- 172.21.15.103:0/2973827744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea700a0a30 con 0x7fea701409e0 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea6ffff640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea701df5e0 0x7fea700a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea75075640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea701409e0 0x7fea70140df0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fea700b9f60 tx=0x7fea6800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:13.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea6d7fa640 1 -- 172.21.15.103:0/2973827744 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68015430 con 0x7fea701409e0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea6d7fa640 1 -- 172.21.15.103:0/2973827744 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea6801d070 con 0x7fea701409e0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea701dfb00 con 0x7fea701409e0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea6d7fa640 1 -- 172.21.15.103:0/2973827744 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea68015830 con 0x7fea701409e0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.997+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea700a1620 con 0x7fea701409e0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.998+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea7006a130 con 0x7fea701409e0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.999+0000 7fea6d7fa640 1 -- 172.21.15.103:0/2973827744 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7fea680159d0 con 0x7fea701409e0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.999+0000 7fea6d7fa640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fea5c0744b0 0x7fea5c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.999+0000 7fea74874640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fea5c0744b0 0x7fea5c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:12.999+0000 7fea6d7fa640 1 -- 172.21.15.103:0/2973827744 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7fea68095d00 con 0x7fea701409e0 2024-04-25T10:36:13.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.000+0000 7fea74874640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fea5c0744b0 0x7fea5c0769c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea60001eb0 tx=0x7fea60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:13.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.004+0000 7fea6d7fa640 1 -- 172.21.15.103:0/2973827744 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea68010040 con 0x7fea701409e0 2024-04-25T10:36:13.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.180+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea700b3440 con 0x7fea701409e0 2024-04-25T10:36:13.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.182+0000 7fea6d7fa640 1 -- 172.21.15.103:0/2973827744 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16975 (secure 0 0 0) 0x7fea6805fda0 con 0x7fea701409e0 2024-04-25T10:36:13.184 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-04-25T10:36:13.184 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":23,"fsid":"e6dc88b0-adc9-49ee-9cbd-a80811a8e643","created":"2024-04-25T10:33:18.306058+0000","modified":"2024-04-25T10:35:19.586756+0000","last_up_change":"2024-04-25T10:33:29.624596+0000","last_in_change":"2024-04-25T10:33:20.520610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:33:30.507871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:33:40.625502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:33:41.468654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8a3de346-8fd7-4fca-97cd-ab94a99c5602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6809","nonce":1654732884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6811","nonce":1654732884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6815","nonce":1654732884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":1654732884},{"type":"v1","addr":"172.21.15.103:6813","nonce":1654732884}]},"public_addr":"172.21.15.103:6809/1654732884","cluster_addr":"172.21.15.103:6811/1654732884","heartbeat_back_addr":"172.21.15.103:6815/1654732884","heartbeat_front_addr":"172.21.15.103:6813/1654732884","state":["exists","up"]},{"osd":1,"uuid":"d9441759-dca9-44cd-b845-a4157edfe094","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6817","nonce":1963339576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6819","nonce":1963339576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6823","nonce":1963339576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1963339576},{"type":"v1","addr":"172.21.15.103:6821","nonce":1963339576}]},"public_addr":"172.21.15.103:6817/1963339576","cluster_addr":"172.21.15.103:6819/1963339576","heartbeat_back_addr":"172.21.15.103:6823/1963339576","heartbeat_front_addr":"172.21.15.103:6821/1963339576","state":["exists","up"]},{"osd":2,"uuid":"5b525cd6-3eda-4001-bff7-ecabf98dbb6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6801","nonce":1181469683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6803","nonce":1181469683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6807","nonce":1181469683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1181469683},{"type":"v1","addr":"172.21.15.103:6805","nonce":1181469683}]},"public_addr":"172.21.15.103:6801/1181469683","cluster_addr":"172.21.15.103:6803/1181469683","heartbeat_back_addr":"172.21.15.103:6807/1181469683","heartbeat_front_addr":"172.21.15.103:6805/1181469683","state":["exists","up"]},{"osd":3,"uuid":"44a1d30b-1c85-496f-a24c-81b95d3b0896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6825","nonce":2287324132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6827","nonce":2287324132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6831","nonce":2287324132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2287324132},{"type":"v1","addr":"172.21.15.103:6829","nonce":2287324132}]},"public_addr":"172.21.15.103:6825/2287324132","cluster_addr":"172.21.15.103:6827/2287324132","heartbeat_back_addr":"172.21.15.103:6831/2287324132","heartbeat_front_addr":"172.21.15.103:6829/2287324132","state":["exists","up"]},{"osd":4,"uuid":"b5a29201-a715-43c1-8140-819b38808854","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6809","nonce":1740285832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6811","nonce":1740285832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6815","nonce":1740285832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1740285832},{"type":"v1","addr":"172.21.15.132:6813","nonce":1740285832}]},"public_addr":"172.21.15.132:6809/1740285832","cluster_addr":"172.21.15.132:6811/1740285832","heartbeat_back_addr":"172.21.15.132:6815/1740285832","heartbeat_front_addr":"172.21.15.132:6813/1740285832","state":["exists","up"]},{"osd":5,"uuid":"1be71253-ff24-4977-bfcf-b54d40e26d56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6825","nonce":2888495984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6827","nonce":2888495984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6831","nonce":2888495984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2888495984},{"type":"v1","addr":"172.21.15.132:6829","nonce":2888495984}]},"public_addr":"172.21.15.132:6825/2888495984","cluster_addr":"172.21.15.132:6827/2888495984","heartbeat_back_addr":"172.21.15.132:6831/2888495984","heartbeat_front_addr":"172.21.15.132:6829/2888495984","state":["exists","up"]},{"osd":6,"uuid":"cb795768-9a09-4342-8274-24d649929024","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6801","nonce":3517858433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6803","nonce":3517858433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6807","nonce":3517858433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3517858433},{"type":"v1","addr":"172.21.15.132:6805","nonce":3517858433}]},"public_addr":"172.21.15.132:6801/3517858433","cluster_addr":"172.21.15.132:6803/3517858433","heartbeat_back_addr":"172.21.15.132:6807/3517858433","heartbeat_front_addr":"172.21.15.132:6805/3517858433","state":["exists","up"]},{"osd":7,"uuid":"9ad4b365-afdd-4687-ba16-140d6796a02d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6817","nonce":2222857157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6819","nonce":2222857157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6823","nonce":2222857157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2222857157},{"type":"v1","addr":"172.21.15.132:6821","nonce":2222857157}]},"public_addr":"172.21.15.132:6817/2222857157","cluster_addr":"172.21.15.132:6819/2222857157","heartbeat_back_addr":"172.21.15.132:6823/2222857157","heartbeat_front_addr":"172.21.15.132:6821/2222857157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.748279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.648874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.770748+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.704847+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.737292+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.727311+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.632177+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:33:25.716712+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/2236094452":"2024-04-25T11:35:18.787637+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:36:13.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.184+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fea5c0744b0 msgr2=0x7fea5c0769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.184+0000 7fea76ad8640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fea5c0744b0 0x7fea5c0769c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fea60001eb0 tx=0x7fea60009040 comp rx=0 tx=0).stop 2024-04-25T10:36:13.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.184+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea701409e0 msgr2=0x7fea70140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.184+0000 7fea76ad8640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea701409e0 0x7fea70140df0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fea700b9f60 tx=0x7fea6800f580 comp rx=0 tx=0).stop 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.185+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 shutdown_connections 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.185+0000 7fea76ad8640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7fea5c0744b0 0x7fea5c0769c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.185+0000 7fea76ad8640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea701409e0 0x7fea70140df0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.185+0000 7fea76ad8640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea701df5e0 0x7fea700a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.185+0000 7fea76ad8640 1 --2- 172.21.15.103:0/2973827744 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fea58004800 0x7fea700a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.185+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 >> 172.21.15.103:0/2973827744 conn(0x7fea700b93f0 msgr2=0x7fea70070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.185+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 shutdown_connections 2024-04-25T10:36:13.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.185+0000 7fea76ad8640 1 -- 172.21.15.103:0/2973827744 wait complete. 2024-04-25T10:36:13.198 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:36:13.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.306+0000 7ff0cd39e640 1 Processor -- start 2024-04-25T10:36:13.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.306+0000 7ff0cd39e640 1 -- start start 2024-04-25T10:36:13.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0cd39e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0c809c250 0x7ff0c8149740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0cd39e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c809dd90 0x7ff0c80a0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0cd39e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c809cf80 con 0x7ff0c8149c80 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0cd39e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff0c809d1a0 con 0x7ff0c809c250 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0cd39e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c814a2a0 con 0x7ff0c809dd90 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c67fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff0c8149c80 0x7ff0c809d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:60634/0 (socket says 172.21.15.103:60634) 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c67fc640 1 -- 172.21.15.103:0/675336137 learned_addr learned my addr 172.21.15.103:0/675336137 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c77fe640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c809dd90 0x7ff0c80a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c6ffd640 1 --2- 172.21.15.103:0/675336137 >> v2:172.21.15.132:3300/0 conn(0x7ff0c809c250 0x7ff0c8149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236560607 0 0) 0x7ff0c809cf80 con 0x7ff0c8149c80 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0b0003520 con 0x7ff0c8149c80 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3098609036 0 0) 0x7ff0b0003520 con 0x7ff0c8149c80 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c809dd90 msgr2=0x7ff0c80a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c809dd90 0x7ff0c80a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 >> v2:172.21.15.132:3300/0 conn(0x7ff0c809c250 msgr2=0x7ff0c8149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:13.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 --2- 172.21.15.103:0/675336137 >> v2:172.21.15.132:3300/0 conn(0x7ff0c809c250 0x7ff0c8149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c814a580 con 0x7ff0c8149c80 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2687358102 0 0) 0x7ff0bc001670 con 0x7ff0c8149c80 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.307+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 >> v1:172.21.15.103:6789/0 conn(0x7ff0c8149c80 legacy=0x7ff0c809d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c5ffb640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c5ffb640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c809dd90 0x7ff0b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c5ffb640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0b0004d40 0x7ff0b0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c809d1a0 con 0x7ff0b00039b0 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c814a2a0 con 0x7ff0b0004d40 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b000ba40 con 0x7ff0c809dd90 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c6ffd640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c67fc640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c809dd90 0x7ff0b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c77fe640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0b0004d40 0x7ff0b0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c6ffd640 1 -- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c809dd90 msgr2=0x7ff0b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:13.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c6ffd640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c809dd90 0x7ff0b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c6ffd640 1 -- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0b0004d40 msgr2=0x7ff0b0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c6ffd640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0b0004d40 0x7ff0b0005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.308+0000 7ff0c6ffd640 1 -- 172.21.15.103:0/675336137 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b0003520 con 0x7ff0b00039b0 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0c6ffd640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0b0003e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ac0 tx=0x7ff0b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fd8a0706f09d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8036070 con 0x7ff0b00039b0 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff0b8031400 con 0x7ff0b00039b0 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0c5ffb640 1 -- 172.21.15.103:0/675336137 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8009690 con 0x7ff0b00039b0 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0cd39e640 1 -- 172.21.15.103:0/675336137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 msgr2=0x7ff0b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0cd39e640 1 --2- 172.21.15.103:0/675336137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0b0003e20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ac0 tx=0x7ff0b0005830 comp rx=0 tx=0).stop 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0c77fe640 1 -- 172.21.15.103:0/675336137 reap_dead start 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0cd39e640 1 -- 172.21.15.103:0/675336137 shutdown_connections 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.309+0000 7ff0cd39e640 1 -- 172.21.15.103:0/675336137 >> 172.21.15.103:0/675336137 conn(0x7ff0c80bb5e0 msgr2=0x7ff0c80bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.310+0000 7ff0cd39e640 1 -- 172.21.15.103:0/675336137 shutdown_connections 2024-04-25T10:36:13.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.310+0000 7ff0cd39e640 1 -- 172.21.15.103:0/675336137 wait complete. 2024-04-25T10:36:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.311+0000 7ff0cd39e640 1 Processor -- start 2024-04-25T10:36:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.311+0000 7ff0cd39e640 1 -- start start 2024-04-25T10:36:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0cd39e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0c80b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0cd39e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c80a3dd0 0x7ff0c8146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0cd39e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c8146d90 0x7ff0c80b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0cd39e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c80a0580 con 0x7ff0b00039b0 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0cd39e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c80a0400 con 0x7ff0c8146d90 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0cd39e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7ff0c80a0700 con 0x7ff0c80a3dd0 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0c80b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0c80b84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45474/0 (socket says 172.21.15.103:45474) 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.312+0000 7ff0c6ffd640 1 -- 172.21.15.103:0/4030018190 learned_addr learned my addr 172.21.15.103:0/4030018190 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0c6ffd640 1 -- 172.21.15.103:0/4030018190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c80a3dd0 msgr2=0x7ff0c8146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0c6ffd640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c80a3dd0 0x7ff0c8146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0c6ffd640 1 -- 172.21.15.103:0/4030018190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c8146d90 msgr2=0x7ff0c80b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0c6ffd640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c8146d90 0x7ff0c80b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0c6ffd640 1 -- 172.21.15.103:0/4030018190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c80b31b0 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0c6ffd640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0c80b84b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8034040 tx=0x7ff0b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0af7fe640 1 -- 172.21.15.103:0/4030018190 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8040020 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0af7fe640 1 -- 172.21.15.103:0/4030018190 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff0b80038d0 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c80b7f90 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0af7fe640 1 -- 172.21.15.103:0/4030018190 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8036040 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.313+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c80a41e0 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.314+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c80b2fc0 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.315+0000 7ff0af7fe640 1 -- 172.21.15.103:0/4030018190 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7ff0b8043020 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.315+0000 7ff0af7fe640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff0b40744b0 0x7ff0b40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.315+0000 7ff0af7fe640 1 -- 172.21.15.103:0/4030018190 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5868+0+0 (secure 0 0 0) 0x7ff0b80b4ed0 con 0x7ff0b00039b0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.315+0000 7ff0c67fc640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff0b40744b0 0x7ff0b40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.316+0000 7ff0c67fc640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff0b40744b0 0x7ff0b40769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80b6d80 tx=0x7ff0bc000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:13.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.320+0000 7ff0af7fe640 1 -- 172.21.15.103:0/4030018190 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff0b807f5c0 con 0x7ff0b00039b0 2024-04-25T10:36:13.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:36:13.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:36:13.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.535+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff0c80b2900 con 0x7ff0b00039b0 2024-04-25T10:36:13.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.538+0000 7ff0af7fe640 1 -- 172.21.15.103:0/4030018190 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7ff0b807eec0 con 0x7ff0b00039b0 2024-04-25T10:36:13.539 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:36:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff0b40744b0 msgr2=0x7ff0b40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff0b40744b0 0x7ff0b40769c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80b6d80 tx=0x7ff0bc000bc0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 msgr2=0x7ff0c80b84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0c80b84b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8034040 tx=0x7ff0b8004730 comp rx=0 tx=0).stop 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 shutdown_connections 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7ff0b40744b0 0x7ff0b40769c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c8146d90 0x7ff0c80b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff0c80a3dd0 0x7ff0c8146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 --2- 172.21.15.103:0/4030018190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0b00039b0 0x7ff0c80b84b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 >> 172.21.15.103:0/4030018190 conn(0x7ff0c80bb5e0 msgr2=0x7ff0c8075c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 shutdown_connections 2024-04-25T10:36:13.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.540+0000 7ff0cd39e640 1 -- 172.21.15.103:0/4030018190 wait complete. 2024-04-25T10:36:13.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:36:13.602 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-04-25T10:36:13.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.703+0000 7f26c3fff640 1 Processor -- start 2024-04-25T10:36:13.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.703+0000 7f26c3fff640 1 -- start start 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26c3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26c40b63c0 0x7f26c40b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26c3fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26c414d390 0x7f26c4153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26c3fff640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c40b6b70 con 0x7f26c40b4f60 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26c3fff640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f26c40b71c0 con 0x7f26c414d390 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26c3fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f26c40b6e50 con 0x7f26c40b63c0 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26c37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26c414d390 0x7f26c4153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26bbfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f26c40b4f60 0x7f26c414cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56208/0 (socket says 172.21.15.103:56208) 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26c37fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f26c414d390 0x7f26c4153ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56188/0 (socket says 172.21.15.103:56188) 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26bbfff640 1 -- 172.21.15.103:0/3045884066 learned_addr learned my addr 172.21.15.103:0/3045884066 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.704+0000 7f26c2ffd640 1 --2- 172.21.15.103:0/3045884066 >> v2:172.21.15.132:3300/0 conn(0x7f26c40b63c0 0x7f26c40b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.705+0000 7f26c37fe640 1 -- 172.21.15.103:0/3045884066 >> v2:172.21.15.132:3300/0 conn(0x7f26c40b63c0 msgr2=0x7f26c40b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:13.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.705+0000 7f26c37fe640 1 --2- 172.21.15.103:0/3045884066 >> v2:172.21.15.132:3300/0 conn(0x7f26c40b63c0 0x7f26c40b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.705+0000 7f26c37fe640 1 -- 172.21.15.103:0/3045884066 >> v1:172.21.15.103:6789/0 conn(0x7f26c40b4f60 legacy=0x7f26c414cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.705+0000 7f26c37fe640 1 -- 172.21.15.103:0/3045884066 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c40b67d0 con 0x7f26c414d390 2024-04-25T10:36:13.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.705+0000 7f26c37fe640 1 --2- 172.21.15.103:0/3045884066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c414d390 0x7f26c4153ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26c40bc2e0 tx=0x7f26bc02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0c014d1425d909 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:13.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.705+0000 7f26c27fc640 1 -- 172.21.15.103:0/3045884066 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc007740 con 0x7f26c414d390 2024-04-25T10:36:13.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.705+0000 7f26c27fc640 1 -- 172.21.15.103:0/3045884066 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f26bc0078e0 con 0x7f26c414d390 2024-04-25T10:36:13.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.705+0000 7f26c27fc640 1 -- 172.21.15.103:0/3045884066 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc007cd0 con 0x7f26c414d390 2024-04-25T10:36:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.706+0000 7f26c3fff640 1 -- 172.21.15.103:0/3045884066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c414d390 msgr2=0x7f26c4153ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.706+0000 7f26c3fff640 1 --2- 172.21.15.103:0/3045884066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c414d390 0x7f26c4153ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f26c40bc2e0 tx=0x7f26bc02a560 comp rx=0 tx=0).stop 2024-04-25T10:36:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.706+0000 7f26c3fff640 1 -- 172.21.15.103:0/3045884066 shutdown_connections 2024-04-25T10:36:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.706+0000 7f26c3fff640 1 --2- 172.21.15.103:0/3045884066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c414d390 0x7f26c4153ca0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.706+0000 7f26c3fff640 1 --2- 172.21.15.103:0/3045884066 >> v2:172.21.15.132:3300/0 conn(0x7f26c40b63c0 0x7f26c40b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.706+0000 7f26c3fff640 1 -- 172.21.15.103:0/3045884066 >> 172.21.15.103:0/3045884066 conn(0x7f26c40be7c0 msgr2=0x7f26c40bebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.706+0000 7f26c3fff640 1 -- 172.21.15.103:0/3045884066 shutdown_connections 2024-04-25T10:36:13.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.706+0000 7f26c3fff640 1 -- 172.21.15.103:0/3045884066 wait complete. 2024-04-25T10:36:13.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.708+0000 7f26c3fff640 1 Processor -- start 2024-04-25T10:36:13.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.708+0000 7f26c3fff640 1 -- start start 2024-04-25T10:36:13.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c40b4f60 0x7f26c41d4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26c40b63c0 0x7f26c41d3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26c414d390 0x7f26c41425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c3fff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26c40b7360 con 0x7f26c40b4f60 2024-04-25T10:36:13.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c3fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f26c40b8320 con 0x7f26c414d390 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c3fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f26c40b74e0 con 0x7f26c40b63c0 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c40b4f60 0x7f26c41d4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c40b4f60 0x7f26c41d4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56196/0 (socket says 172.21.15.103:56196) 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 -- 172.21.15.103:0/266206118 learned_addr learned my addr 172.21.15.103:0/266206118 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c37fe640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26c414d390 0x7f26c41425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26bbfff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26c40b63c0 0x7f26c41d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 -- 172.21.15.103:0/266206118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26c40b63c0 msgr2=0x7f26c41d3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26c40b63c0 0x7f26c41d3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 -- 172.21.15.103:0/266206118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26c414d390 msgr2=0x7f26c41425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26c414d390 0x7f26c41425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 -- 172.21.15.103:0/266206118 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c41d3870 con 0x7f26c40b4f60 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c2ffd640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c40b4f60 0x7f26c41d4d60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f26b400d5a0 tx=0x7f26b400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26bb7fe640 1 -- 172.21.15.103:0/266206118 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4019070 con 0x7f26c40b4f60 2024-04-25T10:36:13.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26bb7fe640 1 -- 172.21.15.103:0/266206118 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f26b4004240 con 0x7f26c40b4f60 2024-04-25T10:36:13.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c41432f0 con 0x7f26c40b4f60 2024-04-25T10:36:13.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26bb7fe640 1 -- 172.21.15.103:0/266206118 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4003610 con 0x7f26c40b4f60 2024-04-25T10:36:13.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.709+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c41dfda0 con 0x7f26c40b4f60 2024-04-25T10:36:13.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.710+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c41df8e0 con 0x7f26c40b4f60 2024-04-25T10:36:13.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.711+0000 7f26bb7fe640 1 -- 172.21.15.103:0/266206118 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f26b401c070 con 0x7f26c40b4f60 2024-04-25T10:36:13.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.711+0000 7f26bb7fe640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26a40744b0 0x7f26a40769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:13.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.712+0000 7f26bb7fe640 1 -- 172.21.15.103:0/266206118 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5954+0+0 (secure 0 0 0) 0x7f26b4094bc0 con 0x7f26c40b4f60 2024-04-25T10:36:13.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.712+0000 7f26bbfff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26a40744b0 0x7f26a40769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:13.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.712+0000 7f26bbfff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26a40744b0 0x7f26a40769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26c41d2db0 tx=0x7f26ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:13.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.716+0000 7f26bb7fe640 1 -- 172.21.15.103:0/266206118 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f26c41df8e0 con 0x7f26c40b4f60 2024-04-25T10:36:13.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:13.927+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f26c4076b90 con 0x7f26c40b4f60 2024-04-25T10:36:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.539+0000 7f26bb7fe640 1 -- 172.21.15.103:0/266206118 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f26b405ec00 con 0x7f26c40b4f60 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26a40744b0 msgr2=0x7f26a40769c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26a40744b0 0x7f26a40769c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26c41d2db0 tx=0x7f26ac009040 comp rx=0 tx=0).stop 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c40b4f60 msgr2=0x7f26c41d4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c40b4f60 0x7f26c41d4d60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f26b400d5a0 tx=0x7f26b400da60 comp rx=0 tx=0).stop 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 shutdown_connections 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f26a40744b0 0x7f26a40769c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26c414d390 0x7f26c41425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f26c40b63c0 0x7f26c41d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 --2- 172.21.15.103:0/266206118 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26c40b4f60 0x7f26c41d4d60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 >> 172.21.15.103:0/266206118 conn(0x7f26c40be7c0 msgr2=0x7f26c40b9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 shutdown_connections 2024-04-25T10:36:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.541+0000 7f26c3fff640 1 -- 172.21.15.103:0/266206118 wait complete. 2024-04-25T10:36:14.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:36:14.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.704+0000 7f1ef696b640 1 Processor -- start 2024-04-25T10:36:14.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.704+0000 7f1ef696b640 1 -- start start 2024-04-25T10:36:14.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.705+0000 7f1ef696b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1ef00b6f10 0x7f1ef01435d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:14.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.705+0000 7f1ef696b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef0143b10 0x7f1ef006c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:14.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.705+0000 7f1ef696b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ef006cb00 0x7f1ef014cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:14.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.705+0000 7f1ef696b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef00739d0 con 0x7f1ef006cb00 2024-04-25T10:36:14.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.705+0000 7f1ef696b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef0073cb0 con 0x7f1ef00b6f10 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.705+0000 7f1ef696b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef0073f90 con 0x7f1ef0143b10 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1ef4f08640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ef006cb00 0x7f1ef014cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1ef4f08640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1ef006cb00 0x7f1ef014cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56204/0 (socket says 172.21.15.103:56204) 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1ef4f08640 1 -- 172.21.15.103:0/3888126207 learned_addr learned my addr 172.21.15.103:0/3888126207 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1eef7fe640 1 --2- 172.21.15.103:0/3888126207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef0143b10 0x7f1ef006c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1eeffff640 1 --2- 172.21.15.103:0/3888126207 >> v2:172.21.15.132:3300/0 conn(0x7f1ef00b6f10 0x7f1ef01435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1ef4f08640 1 -- 172.21.15.103:0/3888126207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef0143b10 msgr2=0x7f1ef006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1ef4f08640 1 --2- 172.21.15.103:0/3888126207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef0143b10 0x7f1ef006c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1ef4f08640 1 -- 172.21.15.103:0/3888126207 >> v2:172.21.15.132:3300/0 conn(0x7f1ef00b6f10 msgr2=0x7f1ef01435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1ef4f08640 1 --2- 172.21.15.103:0/3888126207 >> v2:172.21.15.132:3300/0 conn(0x7f1ef00b6f10 0x7f1ef01435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.706+0000 7f1ef4f08640 1 -- 172.21.15.103:0/3888126207 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef00b7320 con 0x7f1ef006cb00 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.707+0000 7f1ef4f08640 1 --2- 172.21.15.103:0/3888126207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef006cb00 0x7f1ef014cc10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1ef006e7f0 tx=0x7f1ee802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41080e81ebf54aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:14.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.707+0000 7f1eeeffd640 1 -- 172.21.15.103:0/3888126207 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8036070 con 0x7f1ef006cb00 2024-04-25T10:36:14.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.707+0000 7f1eeeffd640 1 -- 172.21.15.103:0/3888126207 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ee8031600 con 0x7f1ef006cb00 2024-04-25T10:36:14.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.707+0000 7f1eeeffd640 1 -- 172.21.15.103:0/3888126207 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80319f0 con 0x7f1ef006cb00 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.707+0000 7f1ef696b640 1 -- 172.21.15.103:0/3888126207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef006cb00 msgr2=0x7f1ef014cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.707+0000 7f1ef696b640 1 --2- 172.21.15.103:0/3888126207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef006cb00 0x7f1ef014cc10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1ef006e7f0 tx=0x7f1ee802a610 comp rx=0 tx=0).stop 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.708+0000 7f1ef696b640 1 -- 172.21.15.103:0/3888126207 shutdown_connections 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.708+0000 7f1ef696b640 1 --2- 172.21.15.103:0/3888126207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef006cb00 0x7f1ef014cc10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.708+0000 7f1ef696b640 1 --2- 172.21.15.103:0/3888126207 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef0143b10 0x7f1ef006c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.708+0000 7f1ef696b640 1 --2- 172.21.15.103:0/3888126207 >> v2:172.21.15.132:3300/0 conn(0x7f1ef00b6f10 0x7f1ef01435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.708+0000 7f1ef696b640 1 -- 172.21.15.103:0/3888126207 >> 172.21.15.103:0/3888126207 conn(0x7f1ef00b84d0 msgr2=0x7f1ef00b88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.708+0000 7f1ef696b640 1 -- 172.21.15.103:0/3888126207 shutdown_connections 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.708+0000 7f1ef696b640 1 -- 172.21.15.103:0/3888126207 wait complete. 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.709+0000 7f1ef696b640 1 Processor -- start 2024-04-25T10:36:14.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.709+0000 7f1ef696b640 1 -- start start 2024-04-25T10:36:14.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1ef696b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef006cb00 0x7f1ef013cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1ef696b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef00b6f10 0x7f1ef01e3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1ef696b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ef0143b10 0x7f1ef013d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1ef696b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef014d4e0 con 0x7f1ef00b6f10 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1ef696b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef014d360 con 0x7f1ef0143b10 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1ef696b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef00727e0 con 0x7f1ef006cb00 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1eef7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef00b6f10 0x7f1ef01e3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1eef7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef00b6f10 0x7f1ef01e3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56214/0 (socket says 172.21.15.103:56214) 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1eef7fe640 1 -- 172.21.15.103:0/2380209662 learned_addr learned my addr 172.21.15.103:0/2380209662 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.710+0000 7f1eeffff640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef006cb00 0x7f1ef013cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1ef4f08640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ef0143b10 0x7f1ef013d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eef7fe640 1 -- 172.21.15.103:0/2380209662 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef006cb00 msgr2=0x7f1ef013cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eef7fe640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef006cb00 0x7f1ef013cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eef7fe640 1 -- 172.21.15.103:0/2380209662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ef0143b10 msgr2=0x7f1ef013d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eef7fe640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ef0143b10 0x7f1ef013d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eef7fe640 1 -- 172.21.15.103:0/2380209662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef00b4b30 con 0x7f1ef00b6f10 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eef7fe640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef00b6f10 0x7f1ef01e3020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400e8a0 tx=0x7f1ee400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eecff9640 1 -- 172.21.15.103:0/2380209662 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4017070 con 0x7f1ef00b6f10 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eecff9640 1 -- 172.21.15.103:0/2380209662 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ee400c940 con 0x7f1ef00b6f10 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1eecff9640 1 -- 172.21.15.103:0/2380209662 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee400cd50 con 0x7f1ef00b6f10 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef00b4db0 con 0x7f1ef00b6f10 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.711+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef013f6d0 con 0x7f1ef00b6f10 2024-04-25T10:36:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.712+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef006a130 con 0x7f1ef00b6f10 2024-04-25T10:36:14.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.713+0000 7f1eecff9640 1 -- 172.21.15.103:0/2380209662 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f1ee401a070 con 0x7f1ef00b6f10 2024-04-25T10:36:14.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.713+0000 7f1eecff9640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1edc0744e0 0x7f1edc0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:14.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.713+0000 7f1eecff9640 1 -- 172.21.15.103:0/2380209662 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5954+0+0 (secure 0 0 0) 0x7f1ee4095130 con 0x7f1ef00b6f10 2024-04-25T10:36:14.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.713+0000 7f1eeffff640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1edc0744e0 0x7f1edc0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:14.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.714+0000 7f1eeffff640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1edc0744e0 0x7f1edc0769f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00b2780 tx=0x7f1ee0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.718+0000 7f1eecff9640 1 -- 172.21.15.103:0/2380209662 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1ef00b4b30 con 0x7f1ef00b6f10 2024-04-25T10:36:14.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:14.893+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1ef0148220 con 0x7f1ef00b6f10 2024-04-25T10:36:15.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.544+0000 7f1eecff9640 1 -- 172.21.15.103:0/2380209662 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f1ee405f850 con 0x7f1ef00b6f10 2024-04-25T10:36:15.546 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:36:15.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1edc0744e0 msgr2=0x7f1edc0769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:15.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1edc0744e0 0x7f1edc0769f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00b2780 tx=0x7f1ee0008040 comp rx=0 tx=0).stop 2024-04-25T10:36:15.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef00b6f10 msgr2=0x7f1ef01e3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:15.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef00b6f10 0x7f1ef01e3020 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1ee400e8a0 tx=0x7f1ee400ed60 comp rx=0 tx=0).stop 2024-04-25T10:36:15.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 shutdown_connections 2024-04-25T10:36:15.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f1edc0744e0 0x7f1edc0769f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ef0143b10 0x7f1ef013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ef00b6f10 0x7f1ef01e3020 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 --2- 172.21.15.103:0/2380209662 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1ef006cb00 0x7f1ef013cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.548+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 >> 172.21.15.103:0/2380209662 conn(0x7f1ef00b84d0 msgr2=0x7f1ef0142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:15.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.549+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 shutdown_connections 2024-04-25T10:36:15.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.549+0000 7f1ef696b640 1 -- 172.21.15.103:0/2380209662 wait complete. 2024-04-25T10:36:15.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:36:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.674+0000 7f678a2bd640 1 Processor -- start 2024-04-25T10:36:15.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.674+0000 7f678a2bd640 1 -- start start 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678a2bd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6784143910 0x7f678406f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678a2bd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f678406dae0 0x7f6784153e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678a2bd640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67840714c0 con 0x7f678406d6d0 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678a2bd640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f67841498e0 con 0x7f678406dae0 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678a2bd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f6784149bc0 con 0x7f6784143910 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678885a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f678406dae0 0x7f6784153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f67837fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f678406d6d0 0x7f6784070db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56214/0 (socket says 172.21.15.103:56214) 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f67837fe640 1 -- 172.21.15.103:0/984521611 learned_addr learned my addr 172.21.15.103:0/984521611 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f6783fff640 1 --2- 172.21.15.103:0/984521611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6784143910 0x7f678406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678885a640 1 -- 172.21.15.103:0/984521611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6784143910 msgr2=0x7f678406f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:36:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678885a640 1 --2- 172.21.15.103:0/984521611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6784143910 0x7f678406f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f678885a640 1 -- 172.21.15.103:0/984521611 >> v1:172.21.15.103:6789/0 conn(0x7f678406d6d0 legacy=0x7f6784070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.676+0000 7f678885a640 1 -- 172.21.15.103:0/984521611 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6784149ea0 con 0x7f678406dae0 2024-04-25T10:36:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.675+0000 7f6782ffd640 1 -- 172.21.15.103:0/984521611 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179548050 0 0) 0x7f67840714c0 con 0x7f678406d6d0 2024-04-25T10:36:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.676+0000 7f678885a640 1 --2- 172.21.15.103:0/984521611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406dae0 0x7f6784153e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f677c009d90 tx=0x7f677c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4745519892cbef49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.676+0000 7f6782ffd640 1 -- 172.21.15.103:0/984521611 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c031600 con 0x7f678406dae0 2024-04-25T10:36:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.676+0000 7f6782ffd640 1 -- 172.21.15.103:0/984521611 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f677c0317a0 con 0x7f678406dae0 2024-04-25T10:36:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.676+0000 7f6782ffd640 1 -- 172.21.15.103:0/984521611 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c031b90 con 0x7f678406dae0 2024-04-25T10:36:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.677+0000 7f678a2bd640 1 -- 172.21.15.103:0/984521611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406dae0 msgr2=0x7f6784153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.677+0000 7f678a2bd640 1 --2- 172.21.15.103:0/984521611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406dae0 0x7f6784153e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f677c009d90 tx=0x7f677c02a5d0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.677+0000 7f678a2bd640 1 -- 172.21.15.103:0/984521611 shutdown_connections 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.677+0000 7f678a2bd640 1 --2- 172.21.15.103:0/984521611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406dae0 0x7f6784153e10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.677+0000 7f678a2bd640 1 --2- 172.21.15.103:0/984521611 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6784143910 0x7f678406f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.677+0000 7f678a2bd640 1 -- 172.21.15.103:0/984521611 >> 172.21.15.103:0/984521611 conn(0x7f67840bc960 msgr2=0x7f67840bcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.677+0000 7f678a2bd640 1 -- 172.21.15.103:0/984521611 shutdown_connections 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.677+0000 7f678a2bd640 1 -- 172.21.15.103:0/984521611 wait complete. 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.678+0000 7f678a2bd640 1 Processor -- start 2024-04-25T10:36:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.679+0000 7f678a2bd640 1 -- start start 2024-04-25T10:36:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f678a2bd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406d6d0 0x7f6784146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f678a2bd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f678406dae0 0x7f6784142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f678a2bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6784143910 0x7f6784142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f678a2bd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6784072290 con 0x7f678406d6d0 2024-04-25T10:36:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f678a2bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6784072110 con 0x7f6784143910 2024-04-25T10:36:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f678a2bd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 -- 0x7f6784149490 con 0x7f678406dae0 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406d6d0 0x7f6784146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406d6d0 0x7f6784146040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56236/0 (socket says 172.21.15.103:56236) 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 -- 172.21.15.103:0/2812347938 learned_addr learned my addr 172.21.15.103:0/2812347938 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f67837fe640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f678406dae0 0x7f6784142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 -- 172.21.15.103:0/2812347938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f678406dae0 msgr2=0x7f6784142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f678406dae0 0x7f6784142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 -- 172.21.15.103:0/2812347938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6784143910 msgr2=0x7f6784142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6784143910 0x7f6784142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 -- 172.21.15.103:0/2812347938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678414bc40 con 0x7f678406d6d0 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f67837fe640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f678406dae0 0x7f6784142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6783fff640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406d6d0 0x7f6784146040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f677400d5d0 tx=0x7f677400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6780ff9640 1 -- 172.21.15.103:0/2812347938 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774004240 con 0x7f678406d6d0 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6780ff9640 1 -- 172.21.15.103:0/2812347938 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f67740043e0 con 0x7f678406d6d0 2024-04-25T10:36:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678414a780 con 0x7f678406d6d0 2024-04-25T10:36:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f6780ff9640 1 -- 172.21.15.103:0/2812347938 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774003850 con 0x7f678406d6d0 2024-04-25T10:36:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.680+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67841434f0 con 0x7f678406d6d0 2024-04-25T10:36:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.681+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f678406a130 con 0x7f678406d6d0 2024-04-25T10:36:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.682+0000 7f6780ff9640 1 -- 172.21.15.103:0/2812347938 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 96782+0+0 (secure 0 0 0) 0x7f67740039f0 con 0x7f678406d6d0 2024-04-25T10:36:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.682+0000 7f6780ff9640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f67700744e0 0x7f67700769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:36:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.683+0000 7f6780ff9640 1 -- 172.21.15.103:0/2812347938 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5516+0+0 (secure 0 0 0) 0x7f6774095450 con 0x7f678406d6d0 2024-04-25T10:36:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.683+0000 7f67837fe640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f67700744e0 0x7f67700769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:36:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.683+0000 7f67837fe640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f67700744e0 0x7f67700769f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67841e3440 tx=0x7f6778009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:36:15.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.687+0000 7f6780ff9640 1 -- 172.21.15.103:0/2812347938 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f677405fca0 con 0x7f678406d6d0 2024-04-25T10:36:15.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:15.866+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f67840b36d0 con 0x7f678406d6d0 2024-04-25T10:36:16.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.549+0000 7f6780ff9640 1 -- 172.21.15.103:0/2812347938 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f677405f5a0 con 0x7f678406d6d0 2024-04-25T10:36:16.551 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-04-25T10:36:16.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f67700744e0 msgr2=0x7f67700769f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f67700744e0 0x7f67700769f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67841e3440 tx=0x7f6778009040 comp rx=0 tx=0).stop 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406d6d0 msgr2=0x7f6784146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406d6d0 0x7f6784146040 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f677400d5d0 tx=0x7f677400da90 comp rx=0 tx=0).stop 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 shutdown_connections 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:6832/1879218478,v1:172.21.15.103:6833/1879218478] conn(0x7f67700744e0 0x7f67700769f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6784143910 0x7f6784142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f678406dae0 0x7f6784142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 --2- 172.21.15.103:0/2812347938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f678406d6d0 0x7f6784146040 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 >> 172.21.15.103:0/2812347938 conn(0x7f67840bc960 msgr2=0x7f67840b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 shutdown_connections 2024-04-25T10:36:16.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-04-25T10:36:16.552+0000 7f678a2bd640 1 -- 172.21.15.103:0/2812347938 wait complete. 2024-04-25T10:36:16.568 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T10:36:16.568 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:36:16.568 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:16.581 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:36:16.581 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:36:16.581 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:16.593 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:36:16.593 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T10:36:16.593 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T10:36:16.593 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:16.647 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T10:36:16.647 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T10:36:16.647 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:16.712 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T10:36:16.713 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T10:36:16.713 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:16.779 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T10:36:16.779 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T10:36:16.780 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:16.844 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T10:36:16.844 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T10:36:16.844 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:16.877 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T10:36:16.877 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T10:36:16.877 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:16.952 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T10:36:16.953 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T10:36:16.953 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:17.018 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T10:36:17.018 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T10:36:17.018 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:17.087 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T10:36:17.087 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T10:36:17.088 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T10:36:17.088 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:17.115 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T10:36:17.115 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T10:36:17.115 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:17.156 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T10:36:17.156 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T10:36:17.156 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T10:36:17.156 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:17.167 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T10:36:17.168 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T10:36:17.168 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:17.208 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T10:36:17.208 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T10:36:17.208 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:36:17.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T10:36:17.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T10:36:17.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T10:36:17.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T10:36:17.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T10:36:17.261 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T10:36:17.262 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T10:36:17.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T10:36:17.298 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:36:17.298 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T10:36:17.493 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:36:17.493 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T10:36:17.560 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:36:17.560 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T10:36:17.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:36:17.625 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T10:36:17.674 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:36:17.674 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T10:36:17.883 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:36:17.884 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T10:36:17.976 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:36:17.977 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T10:36:18.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:36:18.034 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T10:36:18.091 INFO:tasks.ceph:Archiving mon data... 2024-04-25T10:36:18.092 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/data/mon.a.tgz 2024-04-25T10:36:18.092 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-04-25T10:36:18.108 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.cQV8pS1HzQ 2024-04-25T10:36:18.108 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cQV8pS1HzQ 2024-04-25T10:36:18.226 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.cQV8pS1HzQ 2024-04-25T10:36:18.308 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.cQV8pS1HzQ is 262KB 2024-04-25T10:36:18.403 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.cQV8pS1HzQ 2024-04-25T10:36:18.418 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/data/mon.b.tgz 2024-04-25T10:36:18.418 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-25T10:36:18.435 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.3K1dbyhLEi 2024-04-25T10:36:18.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.3K1dbyhLEi 2024-04-25T10:36:18.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.3K1dbyhLEi 2024-04-25T10:36:18.652 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.3K1dbyhLEi is 355KB 2024-04-25T10:36:18.750 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.3K1dbyhLEi 2024-04-25T10:36:18.764 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/data/mon.c.tgz 2024-04-25T10:36:18.765 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-25T10:36:18.819 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.QE9lfMHs4y 2024-04-25T10:36:18.819 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QE9lfMHs4y 2024-04-25T10:36:18.945 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.QE9lfMHs4y 2024-04-25T10:36:19.026 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.QE9lfMHs4y is 355KB 2024-04-25T10:36:19.122 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.QE9lfMHs4y 2024-04-25T10:36:19.136 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T10:36:19.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T10:36:19.139 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T10:36:19.219 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T10:36:19.253 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T10:36:19.253 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T10:36:19.255 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/remote/smithi103/crash 2024-04-25T10:36:19.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T10:36:19.285 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/remote/smithi132/crash 2024-04-25T10:36:19.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T10:36:19.316 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T10:36:19.316 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:36:19.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:36:19.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T10:36:19.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T10:36:19.472 INFO:tasks.ceph:Compressing logs... 2024-04-25T10:36:19.472 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T10:36:19.491 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T10:36:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T10:36:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34477.log 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34477.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34477.log.gz 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34517.log 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.5.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34266.log 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.4.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34517.log.gz 2024-04-25T10:36:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34391.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34346.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34266.log.gz 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34437.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34346.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34391.log.gz 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34346.log.gz 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34437.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mgr.x.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34437.log.gz 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34557.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34306.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34557.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34557.log.gz 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34306.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34306.log.gz 2024-04-25T10:36:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mon.b.log: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40824.log 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41164.log 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42102.log 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40824.log: /var/log/ceph/ceph-client.admin.41164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40711.log 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40824.log.gz 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42102.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41164.log.gz 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6%/var/log/ceph/ceph-client.admin.40711.log: -- replaced with /var/log/ceph/ceph-client.admin.42102.log.gz 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40499.log 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40711.log.gz 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40755.log 2024-04-25T10:36:19.591 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43924.log 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gz 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44428.log 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40499.log.gz 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43924.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40755.log.gz 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40353.log 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43924.log.gz 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44428.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40353.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.44428.log.gz -5 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34443.log 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40353.log.gz 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44386.log 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34443.log.gz 2024-04-25T10:36:19.592 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40625.log 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41421.log 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44386.log.gz 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40625.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41421.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40625.log.gz 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43798.log 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.2.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41421.log.gz 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42844.log 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43672.log 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43798.log.gz 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42844.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43672.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.42844.log.gz --verbose 2024-04-25T10:36:19.593 INFO:teuthology.orchestra.run.smithi103.stderr: -- /var/log/ceph/ceph-client.admin.41080.log 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42928.log 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43672.log.gz 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42592.log 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41080.log.gz 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42928.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42802.log 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40996.log 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42592.log: /var/log/ceph/ceph-client.admin.42802.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42928.log.gz 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44008.log 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42592.log.gz 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40996.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42802.log.gz 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44008.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40996.log.gz 2024-04-25T10:36:19.594 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40583.log 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43224.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44008.log.gz 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44943.log 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42718.log 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40583.log.gz 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40954.log 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42718.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44943.log.gz 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42718.log.gz 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41763.log 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40954.log.gz 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.44612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40908.log 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2024-04-25T10:36:19.595 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43882.log 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42099.log 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40908.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41763.log.gz 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40908.log.gz 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42099.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44050.log 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42099.log.gz 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41427.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44050.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41766.log 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44050.log.gz 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41765.log 2024-04-25T10:36:19.596 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41765.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41766.log.gz 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43966.log 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41962.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41765.log.gz 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40415.log 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43966.log.gz 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42886.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T10:36:19.597 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40415.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2024-04-25T10:36:19.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42001.log 2024-04-25T10:36:19.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.0.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40415.log.gz 2024-04-25T10:36:19.598 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42098.log 2024-04-25T10:36:19.598 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42676.log 2024-04-25T10:36:19.598 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42001.log.gz 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40184.log 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42676.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42098.log.gz 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42676.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34179.log 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44530.log 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40184.log: /var/log/ceph/ceph-client.admin.34179.log: 88.7% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34179.log.gz 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40184.log.gz 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41429.log 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40457.log 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44530.log.gz 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40457.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41429.log.gz 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43756.log 2024-04-25T10:36:19.599 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40457.log.gz 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34546.log 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43756.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43756.log.gz 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41430.log 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34546.log: /var/log/ceph/ceph-client.admin.41430.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34546.log.gz 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41430.log.gz 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44901.log 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.42634.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44901.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44901.log.gz 2024-04-25T10:36:19.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41761.log 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42382.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42002.log 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41761.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41761.log.gz 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44738.log 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42002.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42002.log.gz 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42340.log 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44738.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44738.log.gz 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44858.log 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42340.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42340.log.gz 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44858.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44858.log.gz 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2024-04-25T10:36:19.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44176.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44218.log 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44092.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41206.log 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44218.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44218.log.gz 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28323.log 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44654.log 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41206.log.gz 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.tmp-client.admin.28323.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28323.log.gz 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40667.log 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40667.log: /var/log/ceph/ceph-client.admin.44654.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40667.log.gz 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44654.log.gz 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-04-25T10:36:19.602 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44780.log 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41420.log 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44780.log: /var/log/ceph/ceph-client.admin.42466.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44780.log.gz 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42424.log 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43840.log 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41420.log: /var/log/ceph/ceph-client.admin.42424.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41420.log.gz 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42424.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41428.log 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43840.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43840.log.gz 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41758.log 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42298.log 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41428.log: /var/log/ceph/ceph-client.admin.41758.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41428.log.gz 2024-04-25T10:36:19.603 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41758.log.gzgzip 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43630.log 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42298.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42298.log.gz 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40541.log 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43630.log: /var/log/ceph/ceph-client.admin.41760.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43630.log.gz 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41424.log 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40541.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40541.log.gz 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41038.log 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41122.log 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41038.log: /var/log/ceph/ceph-client.admin.41424.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41424.log.gz 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41038.log.gz 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41122.log: /var/log/ceph/ceph-mds.a.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41122.log.gz 2024-04-25T10:36:19.604 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43714.log 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42101.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42100.log 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.43714.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43714.log.gz 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42508.log 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42100.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42100.log.gz 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.42508.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42508.log.gz 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44470.log 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44134.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41762.log 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44470.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44470.log.gz 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44260.log 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41762.log: /var/log/ceph/ceph-client.admin.44260.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41762.log.gz 2024-04-25T10:36:19.605 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41248.log 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44260.log.gz 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41426.log 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44696.log: /var/log/ceph/ceph-client.admin.41248.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41248.log.gz 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40866.log 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40276.log 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.41426.log: /var/log/ceph/ceph-client.admin.40866.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41426.log.gz 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40866.log.gz 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41755.log 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44302.log 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40276.log: /var/log/ceph/ceph-client.admin.41755.log: 88.3% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40276.log.gz 2024-04-25T10:36:19.606 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41755.log.gz 2024-04-25T10:36:19.607 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42760.log 2024-04-25T10:36:19.607 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.44302.log: /var/log/ceph/ceph-client.admin.42760.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44302.log.gz 2024-04-25T10:36:19.607 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42760.log.gz 2024-04-25T10:36:19.607 INFO:teuthology.orchestra.run.smithi132.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T10:36:19.614 INFO:teuthology.orchestra.run.smithi132.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T10:36:19.631 INFO:teuthology.orchestra.run.smithi103.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T10:36:19.643 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T10:36:19.651 INFO:teuthology.orchestra.run.smithi132.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T10:36:19.686 INFO:teuthology.orchestra.run.smithi103.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T10:36:19.697 INFO:teuthology.orchestra.run.smithi132.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T10:36:19.699 INFO:teuthology.orchestra.run.smithi103.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T10:36:19.712 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T10:36:19.713 INFO:teuthology.orchestra.run.smithi132.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T10:36:19.713 INFO:teuthology.orchestra.run.smithi103.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T10:36:19.716 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-04-25T10:36:19.716 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m0.212s 2024-04-25T10:36:19.716 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m0.999s 2024-04-25T10:36:19.716 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m0.091s 2024-04-25T10:36:19.732 INFO:teuthology.orchestra.run.smithi132.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T10:36:19.733 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-25T10:36:19.734 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m0.208s 2024-04-25T10:36:19.734 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m0.767s 2024-04-25T10:36:19.734 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m0.045s 2024-04-25T10:36:19.734 INFO:tasks.ceph:Archiving logs... 2024-04-25T10:36:19.734 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/remote/smithi103/log 2024-04-25T10:36:19.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T10:36:19.999 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/remote/smithi132/log 2024-04-25T10:36:20.000 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T10:36:20.124 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T10:36:20.141 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T10:36:20.141 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T10:36:20.144 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T10:36:20.226 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T10:36:20.235 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T10:36:20.235 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:36:20.238 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:36:20.250 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:36:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-04-25T10:36:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:36:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-04-25T10:36:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +1246us[+1209us] +/- 60ms 2024-04-25T10:36:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -637us[ -674us] +/- 67ms 2024-04-25T10:36:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -706us[ -706us] +/- 62ms 2024-04-25T10:36:20.255 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:36:20.256 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T10:36:20.256 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-04-25T10:36:20.256 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +1283us[+1234us] +/- 60ms 2024-04-25T10:36:20.257 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -641us[ -691us] +/- 67ms 2024-04-25T10:36:20.257 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 58 -705us[ -705us] +/- 62ms 2024-04-25T10:36:20.257 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T10:36:20.257 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T10:36:20.266 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T10:36:20.267 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T10:36:20.277 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T10:36:20.355 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T10:36:20.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T10:36:20.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:36:20.438 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T10:36:20.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:36:20.464 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T10:36:20.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T10:36:20.482 INFO:teuthology.task.internal:Duration was 531.425391 seconds 2024-04-25T10:36:20.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T10:36:20.491 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T10:36:20.491 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T10:36:20.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T10:36:20.528 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:36:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T10:36:20.793 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T10:36:20.794 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-04-25T10:36:20.794 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T10:36:20.847 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T10:36:20.847 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T10:36:20.869 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T10:36:20.870 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T10:36:20.889 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T10:36:20.934 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T10:36:20.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T10:36:20.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T10:36:21.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T10:36:21.077 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T10:36:21.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T10:36:21.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T10:36:21.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T10:36:21.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:36:21.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:36:21.164 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-04-25T10:36:21.187 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-04-25T10:36:21.208 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:36:21.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:36:21.230 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:36:21.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:36:21.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T10:36:21.273 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T10:36:21.274 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/remote/smithi103 2024-04-25T10:36:21.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T10:36:21.306 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673084/remote/smithi132 2024-04-25T10:36:21.306 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T10:36:21.337 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T10:36:21.337 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T10:36:21.342 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T10:36:21.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T10:36:21.398 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T10:36:21.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T10:36:21.408 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T10:36:21.408 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T10:36:21.411 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T10:36:21.423 INFO:teuthology.orchestra.run.smithi103.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 10:36 /home/ubuntu/cephtest 2024-04-25T10:36:21.440 INFO:teuthology.orchestra.run.smithi132.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 10:36 /home/ubuntu/cephtest 2024-04-25T10:36:21.442 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T10:36:21.452 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T10:36:21.474 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-1-client-coloc conf/{client mds mgr mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/client} duration: 531.425390958786 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T10:36:21.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T10:36:21.542 INFO:teuthology.run:pass